ADA  1  3  09  7 


Technical  Report  514 


EXTENSION  AND  VALIDATION  OF  RESEARCH  ON 
ACQUISITION  AND  RETENTION  OF  COGNITIVE 
VERSUS  PERCEPTUALLY  ORIENTED 
TRAINING  MATERIALS 


i/J 


Roseann  Mikos  and  Robert  J.  Casey.  Jr. 
Canyon  Research  Group,  Inc. 

and 

John  Lockhart 
Army  Research  Institute 

ARI  FIELD  UNIT  AT  FORT  BLISS.  TEXAS 


\ 


>- 

O 

C_5 


U.  S.  Army 

Research  Institute  for  the  Behavioral  and  Social  Sciences 

June  1980 

Approved  for  public  release:  distribution  unlimited. 


83  OR  01  01  0 


U.  S.  ARMY  RESEARCH  INSTITUTE 

FOR  THE  BEHAVIORAL  AND  SOCIAL  SCIENCES 

A  Field  Operating  Agency  under  the  Jurisdiction  of  the 
Deputy  Chief  of  Staff  for  Personnel 


JOSEPH  ZEIDNER 
Technical  Director 


FRANKLIN  A.  HART 
Colonel,  US  Army 
Commander 


Research  accomplished  under  contract 
for  the  Department  of  the  Army 


Canyon  Research  Group,  Inc, 


NOTICES 


DISTRIBUTION  Primary  distribution  ot  ,h.s  report  Hu  been  made  by  ARI.  Pt.aia  address  correspondence 
concerning  distribution  o(  reports  to  U  S.  Army  Research  Institute  lor  the  Btheviorel  and  Social  Sciancas. 
ATTN:  PERI -TP,  5001  Eisenhower  Avenue,  Alexandria,  Virginia  22333 


flNAL  PI5f*-fl5ITlQN  Th,«  report  may  ba  destroyad  when  it  it  no  longar  neadao.  Piaaw  do  not  ratutn  it  to 
tha  U  S  Army  Raaearch  inatitute  lot  tna  Bahevidrai  and  Social  Sciancea. 


Th*  '"’Oinga  m  ih,s  report  ata  not  to  Ba  conatruad  as  an  official  Deoartmem  of  tha  Army  position 
unless  so  designated  by  other  authorised  documents. 


Unclassified 


StCu«f*v  Cl  ASS'  f  *C  A  T»On  Of  Tm»S  #»c[  'Whmn  Dei «  Fnr«r»d) 


REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

i  report  number  2  oovt  accession  no. 

Technical  Report  514  { 

J  RECIPIENT'S  CATALOG  NUMBER 

4  TiTlE  for*d  Subtitle) 

Extension  and  Validation  of  Research  on  Acquisition 
and  Retention  of  Cognitive  Versus  Perceptually 
Oriented  Training  Materials 

s  tyre  of  report  •  period  covered 

Final  Report 

Apr  1979  -  June  1980 

t.  PERFORMING  ORG.  report  numBEH 

7  AuTmOR/i) 

Roseann  Mikos 

Robert  J.  Casey,  Jr. 

John  Lockhart 

•  CONTRACT  or  grant  NUMBER/*) 

MDA903-79-C-0270 

»  PERFORMING  organization  name  and  aooress 

Canyon  Research  Group,  Inc. 

741  Lakefield  Road,  Suite  B 

Westlake  Village,  CA  91361 

10  program  Element  project  Task 
AREA  a  work  UNIT  NUMBERS 

2Q762722A791 

ii.  controlling  office  name  ano  aooress 

U.S.  Army  Research  Institute  for  the  Behavioral  and 
Social  Sciences 

5001  Eisenhower  Ave. 

Alexandria,  Virainia  22333 

12  REPORT  DATE 

June  1980 

11-  NUMBER  OF  pages 

173 

'4  MONITORING  AGENCY  name  S  AOORESSflf  dllt.rmnl  from  Controlling  Ollic.) 

ARI  Field  Unit 

P.0.  Box  6057 

Ft.  Bliss,  Texas  79916 

is  security  Class  (oi  mi.  t.porn 

Unclassified 

Ho.  DECLASSIFICATION  DOWNGRADING 
SCHEDULE 

i*  Distribution  statement  (oi  tht*  Report) 

Approved  for  public  release;  distribution  unlimited. 

'7  DISTRIBUTION  STATEMENT  (ol  the  ebelrect  entered  m  Block  20.  It  different  from  Report) 

»•  Supplementary  notes 

If-  KEY  WORDS  (Coni mu*  on  aid*  it  neceeemry  and  Identity  by  block  number) 

Training  Aptitude  Profiles 

Apti tude-Treatment-Interaction  Instructional  Strategies 

Retention  Air  Defense 

Student  Characteristics 

20  ABSTRACT  (Continue  on  ravtria  »idm  It  neceeemry  and  Identity  by  block  number) 

The  purpose  of  the  study  was  to  investigate  the  relationships  between  existing 
population  specific  aptitude  patterns  and  training  performance  for  experienced 

REDEYE  gunners  and  initial  CHAPARRAL/VULCAN  trainees.  The  technical  objective 
was  *to  expand  on  current,  successful  research  efforts  in  the  application  of 
population  specific  instructional  strategies  by  determining  the  general i zabi lity 
of  present  categories  of  trainee  population  characteristics  and  by  analyzing 
training  sped fications  of  existing  Short  Range  Air  Defense (  SHORAD)  weapons 

DD  \JM.)  1473  COITION  or  «  NOV  65  IS  OISOLETt 

_ Unclassified. 


i 


i 


security  CLASSIFICATION  of  This  PAGE  iPTian  Oaf*  Enl.r.d) 


I 


sicu»»ty  cl  assific *tiqn  or  this  ©•#• 


20.  Abstract  (continued) 

'systems  as  a  function  of  existing  population  characteristics  and  specified 
instructional  strategies.* 

The  program  was  accomplished  in  two  phases,  the  REDEYE  Study  and  the  CHAPARRAL/ 
VULCAN  (C/V)  Training  Analysis.  Within  the  REDEYE  Study  were  two  different 
phases  of  analysis  (confi rmatory  and  exploratory).  The  REDEYE  Study  was  con¬ 
ducted  using  an  extension  of  the  basic  aptitude  x  treatment  interaction  (ATI) 
approach. 

The  confirmatory  analysis  was  designed  to  test  the  interaction  between  specific 
aptitude  profiles,  which  had  been  identified  in  earlier  research,  and  the  in¬ 
structional  strategies  designed  to  match  the  profiles  on  performance.  Results 
confirmed  the  existence  of  the  same  three  aptitude  profiles  for  REDEYE  gunners 
that  had  been  previously  identified.  While  significant  aptitude  profile  by 
instructional  strategy  interaction  effects  were  not  observed,  at  least-  one  of 
the  strategies  had  a  differential  effect  on  performance  for  different  profile 
groups. 

The  ATI  methodology  that  was  used  in  Phase  I  (building  and  implementing  instruc¬ 
tional  strategies  appropriate  to  aptitude  characteristics  of  a  specific  popula¬ 
tion)  remains  a  promising  approach  for  the  improvement  of  military  training  if 
appropriate  controls  can  be  maintained  while  the  methodology  is  perfected. 

After  completion  of  the  confirmatory  analyses,  exploratory  analyses  (factor 
analyses  and  canonical  correlation  analyses)  were  conducted  in  an  effort  to 
explain  the  underlying  structure  upon  which  the  aptitude  profiles  were  based  and 
to  investigate  the  relationships  between  the  set  of  performance  measures  and  an 
expanded  set  of  aptitude  variables.  Factor  analytic  results  suggested  additional 
variables  important  to  the  underlying  structure  of  aptitude  patterns  in  the 
REDEYE  sample. 

Phase  II,  the  CHAPARRAL/VULCAN  Training  Analysis,  was  entirely  exploratory  in 
nature.  The  analyses  paralleled  those  during  the  exploratory  portion  of  the 
REDEYE  study. 

Activities  during  the  C/V  analysis  included  analyzing  existing  Advanced  Indivi¬ 
dual  Training  (AIT)  and  collecting  and  analyzing  AIT  performance  data  as  it  re¬ 
lated  to  the  aptitude  patterns  in  the  C/V  samples.  Two  independent  sets  of  data 
were  collected  during  Phase  II,  one  for  CHAPARRAL  and  one  for  VULCAN.  Results 
suggested  that  the  most  important  aptitudes  which  characterize  C/V  trainees  are 
not  necessarily  the  most  important  in  predicting  training  performance. 

Finally,  the  results  of  the  Phase  I  exploratory  analyses  and  the  C/V  analyses  were 
synthesized  in  order  to  suggest  common  patterns  concerning  psychological  abi  1  i ties 
that  relate  to  air  defense  training  performance.  In  addition,  the  synthesis  re¬ 
vealed  some  unique  patterns  between  the  three  groups  (REDEYE,  CHAPARRAL,  VULCAN). 

The  second  part  of  Phase  I  and  all  of  Phase  II  resulted  in  the  identification  of 
many  common  factors  which  varied  in  both  strength  and  relative  predictive  ability. 
The  analyses  suggested  a  number  of  additional  variables  that  appear  to  be  impor¬ 
tant  as  part  of  aptitude  profiles  and  which  may  be  important  for  instructional 
strategy  development. 
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A R I  Research  Reports  and  Technical  Reports  are  intended  for  sponsors  of 
R&D  tasks  and  for  other  research  and  military  agencies.  Any  findings  ready 
for  implementation  at  the  time  of  publication  are  presented  in  the  last  part 
of  the  Brief.  Upon  completion  of  a  major  [these  of  the  task,  formal  recom¬ 
mendations  for  official  action  normally  are  conveyed  to  appropriate  military 
agencies  by  briefing  or  Disposition  Form. 


FOREWORD 


The  US  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences 
(ARI)  has  been  concerned  with  identification  of  the  relationships  of  the 
cognitive,  perceptual,  and  affective  characteristics  of  soldiers  to  military 
training  and  on-the-job  performance-  The  ARI  Field  Unit  at  Ft.  Bliss,  TX 
in  its  work  unit,  "Evaluating  Air  Defense  Crewmen  Aptitude  and  Performance," 
is  building  a  data  base  on  the  relationship  between  individual  differences 
and  Air  Defense  Advanced  Individual  Training.  The  data  base  is  designed  to 
support  the  following  alternatives:  (1)  improve  selection  criteria  for 
training,  (2)  aptitude  profile  for  training  strategy  selection  for  new 
weapon  system  training,  and  (3)  utilization  of  sub-population  specific 
instructional  strategies. 

The  present  report  describes  an  extension  of  the  Aptitude  by  Treatment 
Interaction  (ATI)  approach  to  REDEYE  engagement  training,  a  confirmatory 
analysis  of  the  effects  of  aptitude  specific  instructional  strategies 
across  aptitude  group  on  REDEYE  refresher  training,  and  exploratory  analyses 
of  the  relationships  between  cognitive,  perceptual,  and  affective  measures 
of  individual  differences  and  REDEYE,  CHAPARRAL,  and  VULCAN  training 
performance.  The  present  effort  was  performed  also  by  Canyon  Research 
Group,  Inc.,  under  contract  MDA  903-79-C-0270  with  ARI. 

The  research  accomplished  under  Army  Project  2Q762722A791  was  responsive 
to  the  US  Army  Air  Defense  School  at  Ft.  Bliss. 
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BRIEF 


Requirement: 

To  investigate  the  relationships  between  existing  population  specific 
aptitude  patterns  and  training  performance  for  experienced  REDEYE  gunners 
and  for  CHAPARRAL  and  VULCAN  trainees  in  Advanced  Individual  Training. 

Procedure : 

The  program  was  accomplished  in  two  steps,  the  REDEYE  study  and  the 
CHAPARRAL /VULCAN  (C/V)  Training  Analysis.  The  REDEYE  study  included  two 
different  pnases  of  analysi s "(confi rmatory  and  exploratory ) .  The  con¬ 
firmatory  phase  of  the  REDEYE  study  was  conducted  using  an  extension  of 
the  basic  Aptitude  by  Treatment  Interaction  (ATI)  approach  in  which 
REDEYE  refresher  training  courses  emphasizing  four  different  instructional 
strategies  were  compiled.  Three  of  the  instructional  strategies  were 
designed  in  accordance  with  a  "preferential"  or  "compensatory"  model  and 
matched  strategy  characteristics  to  the  predominant  aptitude  characteristics 
of  specific  aptitude  profile  groups  identified  in  earlier  research.  REDEYE 
gunners  at  four  locations  received  refresher  training,  performance  and 
written  testing  on  REDEYE  engagement  tasks  immediately  and  30  days  after 
training,  and  aptitude  testing.  Performance  testing  consisted  of  engaging 
Film  10  (difficult)  targets  and  Film  12  (easy  to  difficult)  targets  with 
tne  REDEVE  weapon.  The  written  test  involved  aircraft  type  identification, 
proportion  of  aircraft  to  range  ring,  and  fire/no  fire  decision  for  each  of 
13  aircraft  images.  The  aptitude  testing  consisted  of  measures  of  the 
three  aptitude  profile  groups  and  additional  measures  to  expand  on  the 
relationsnip  between  REDEYE  performance  and  aptitude. 

The  C/V  training  analysis  included  analyzing  existing  CHAPARRAL  and 
VULCAN  Advanced  Individual  Training  (AIT)  and  collecting  and  analyzing 
AIT  performance  data  and  trainee  aptitude  data.  Exploratory  analyses  of 
the  C/V  ana  REDEYE  data  included  factor  analyses  and  canonical  correlation 
analyses. 

F i ndi ngs : 

For  the  REDEYE  confirmatory  analysis,  aptitude  profile  and  instructional 
strategy  affected  performance  on  Film  12  targets  but  not  Film  10  targets 
immediately  after  training.  REDEYE  gunners  with  Profile  2  (anxious,  2-dimen 
sional  ability)  performed  significantly  better  than  those  with  Profile  3 
(field  dependent,  low  intelligence)  and  Strategy  3  (Practice)  resulted  in 
in  significantly  better  performance  than  Strategy  1  (Independent  Study).  Fo 
the  Range-Ring  Profile  written  test,  both  immediate  and  retention  test 
performance  was  significantly  affected  by  Aptitude  Profile.  The  Profile  1 
group  (field  independent,  high  intelligence)  on  both  the  immediate  and 
retention  tests  and  the  Profile  2  group  on  the  immediate  test  performed 
better  than  gunners  with  Profile  3. 
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For  the  REDEYE  exploratory  analysis,  seven  factors,  accounting  for 
almost  6 7-  of  the  total  variance,  were  found  to  characterize  REDEYE  gunner 
in  units.  Based  on  canonical  correlation  analyses,  five  factors  predicted 
REDEYE  engagement  performance.  The  results  of  the  canonical  correlation 
analysis  supported  the  existence  of  the  aptitude  profiles  established 
previously. 

Exploratory  analyses  of  CHAPARRAL  AIT  data  identified  seven  factors 
which  characteri zed  men  who  completed  CHAPARRAL  AIT  and  which  accounted 
for  61C>  of  the  total  variance.  Three  factors  predicted  CHAPARRAL  AI'r 
performance.  Profile  3  was  the  only  REDEYE  sample  aptitude  profile  com¬ 
bination  wnicn  generalized  to  the  CHAPARRAL  sample. 

Exploratory  analyses  of  VULCAN  AIT  data  identified  seven  factors 
characterizing  men  completing  VULCAN  AIT.  These  factors  accounted  for 
54.9.  of  the  total  variance.  Four  of  the  factors  predicted  VULCAN  AIT 
performance.  Of  the  aptitude  profile  combinations  identified  in  the 
REDEYE  sample.  Profiles  2  and  3  generalized  to  the  VULCAN  sample. 

Utilization  of  Findings: 

The  results  of  this  research  support  the  need  for  the  following 
development: 

(1)  The  methodology  of  building  and  implementing  instructional 
strategies  appropriate  to  aptitude  characteristics  of  a  specific 
population  should  be  tested  using  larger  samples  and  more  precise 
controls  and  performance  measures. 

(2)  The  contribution  of  the  additional  variables  identified  in  the 
exploratory  analyses  of  the  REDEYE,  CHAPARRAL  and  VULCAN  sample  to 
instructional  strategy  development  and  effective  training  should  be 
determined. 

(3)  Relationships  among  affective  variables,  training  climate 
measures,  training  effectiveness,  and  strategy  development  for  team 
tasks  as  compared  to  individual  tasks  should  be  investigated. 
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CHAPTER  : 


SUMMARY  AMD  CONCLUSIONS 
Military  Problem 

The  technical  objective  of  the  research  program  was  "to 
expand  on  current,  successful  research  efforts  in  the 
application  of  population  specific  instructional  strategies 
by  determining  the  generalizabiiity  of  crese.nt  cateqories  of 
trainee  population  characteristics  and  by  analyzing  training 
specifications  of  existing  Short  Range  Air  Defense  (SHORAD) 
weapons  systems  as  a  function  of  existing  population 
characteristics  and  specified  instructional  strategies." 
Existing  SHORAD  weapons  systems  consist  of  REDEYE, 

CHAPARRAL,  and  VULCAN.  This  objective  is  in  keeping  with 
the  U.S.  Army's  concern  to  be  more  responsive  to  the  limits 
of  the  abilities  of  existing  populations.  If  successful, 
personnel  who  might  otherwise  be  excluded  from  training  for 
air  defense  ]obs  could  have  the  opportunity  to  succeed  when 
trained  according  to  methods  that  more  closely  match  their 
individual  aptitude  patterns. 

The  successful  efforts  referred  to  above  concerned 
training  on  REDEYE  target  acquisition,  tracking  and 
engagement  decis ior.-making  using  the  REDEYE  Guided  Missile 
System.  REDEYE  is  man-portable  and  can  be  shoulder-fired  by 
a  single  individual.  CHAPARRAL  uses  larger  heat-seeking 
missiles  mounted  on  a  tracked  vehicle  and  cannot  be 
successfully  operated  without  the  efforts  of  several  team 
members  working  together.  Both  REDEYE  gunners  and  CHAPARRAL 
crewmen  are  trained  within  the  same  MOS  (16?). 

VULCAN  is  an  air  defense  gun  system  that  is  mounted  on 
a  tracked  vehicle  or  on  a  vehicle  which  can  be  towed.  Like 
CHAPARRAL,  it  requires  a  full  crew  for  efficient  operation. 
There  were  indications  from  Air  Defense  School  personnel  at 
Fort  Bliss  that  VULCAN  and  CHAPARRAL  crewmen  were  completing 
Advanced  Individual  Training  (AIT)  without  sufficient 
knowledge  or  skills  to  be  able  to  perform  individual  tasks 
upon  arrival  to  the  unit. 

Research  Problem 

Given  the  above  situation,  the  investigators  were  asked 
to  provide  refresher  training  to  REDEYE  sections  using  those 
strategies  found  to  be  successful  under  the  previous 
contract.  This  was  done  in  order  to  test  further  the 
relative  effectiveness  of  the  earlier  instructional 
strategies.  In  addition,  the  generalizabiiity  of  the 
aptitude  profiles  upon  which  the  instructional  strategies 
were  based,  was  to  be  tested  witnin  both  REDEYE,  CHAPARRAL, 
and  VULCAN  sample  populations. 


CHAPARRAL  and  VULCAN  AIT  performance  data  were  to  be 
analyzed  as  a  function  of  the  previously  identified  aptitude 
profiles  and  of  any  deviations  from  those  profiles--if  they 
existed.  Particular  attention  was  to  be  paid  to  the 
identification  of  possible  areas  of  training  difficulty  and 
to  the  determination  of  areas  in  which  changes  in 
instructional  strategies,  matched  to  aptitude  patterns  of 
CHAPARRAL  and/or  VULCAN  crewmen,  could  be  made.  Special 
emphasis  was  to  be  given  to  complex  procedural  tasks  which 
were  thought  to  be  performed  under  temporal  stress. 


>roach 


A  two-phase  approach  was  planned  to  accomplish  the 
goals  of  the  program.  Each  phase  was  originally  intended  to 
follow  the  successful  completion  of  the  previous  phase.  In 
practice,  it  was  not  possible  for  all  of  the  field  work  to 
occur  within  the  preferred  time  frame  or  sequence. 

Never the  less ,  the  approach  will  be  described  in  the  sequence 
that  was  originally  planned. 


The  first  phase  was  the  REDEYE  Study.  Within  that 
study,  there  were  two  different  phases  of  data  analysis 
(confirmatory  and  exploratory).  Exploratory  analyses  were 
not  conducted  until  after  the  completion  of  the  confirmatory 
analyses.  The  REDEYE  Study  activities  included  analyzing 
current  U.S.  Army  REDEYE  refresher  training,  refining  the 
instructional  strategies  used  in  earlier  research  and 
developing  one  new  strategy,  expanding  the  aptitude  testing 
battery  for  the  aptitude  profile  formation,  improving  the 
discrimination  of  aptitude  profile  groups  from  that  achieved 
in  earlier  research,  conducting  refresher  training  at  four 
different  sites  and  analyzing  the  performance  data  (from 
both  training  and  retention)  as  a  function  of  the  aptitude 
patterns  that  were  exhibited  in  the  sample  population. 

The  second  phase  was  the  CHAPARRAL/VULCAN  Training 
Analysis.  Activities  during  the  CHAPARRAL /VULCAN  Analysis 
included  analyzing  existing  soldier  manuals,  Programs  of 
Instruction  (POIs),  Training  Extension  Course  (TEC)  lessons 
and  other  AIT  related  materials  provided  by  the  Air  Defense 
School,  observing  selected  portions  of  AIT  classes  for 
CHAPARRAL  (16P)  and  VULCAN  (16R)  trainees,  interviewing 
CHAPARRAL /VULCAN  instructors  concerning  AIT  and  unit 
training,  administering  a  slightly  expanded  aptitude  test 
battery  to  a  sample  of  16P  and  16R  trainees,  collecting  and 
analyzing  AIT  performance  data  as  it  related  to  the  aptitude 
patterns  in  the  population,  and  suggesting  possible  changes 
for  instructional  strategies  that  could  be  related  to  the 
aptitude  patterns. 


Results 


Phase  I  resulted  in  the  confirmation  of  the  existence 
of  three  aptitude  profiles  for  REDEYE  gunners  that  had  been 
identified  in  earlier  research  (Hebein,  1978?  Sullivan  et 
al.,  1978).  The  profiles  are:  (1)  analytic  thinking  and 
high  intelligence,  (2)  highly  anxious  with  high 
two-dimensional  perceptual  ability,  (3)  global  thinking  and 
low  intelligence.  A  fourth  group  included  all  men  who  could 
not  qualify  for  any  of  the  identified  profiles.  The  results 
of  a  factor  analysis  suggested  other  variables  important  to 
the  underlying  structure  of  aptitude  patterns  in  the  REDEYE 
sample . 

Instructional  strategies,  designed  in  accordance  with  a 
"preferential"  or  "compensatory"  model  (Salomon,  1972), 
matched  strategy  characteristics  to  the  predominant  aptitude 
characteristics  of  each  profile  group.  An  experiment  was 
performed  to  test  the  interaction  between  instructional 
strategy  and  aptitude  profile.  Exploratory  canonical 
correlation  analyses  suggested  relationships  between 
aptitude  patterns  and  task  performance. 

Analysis  of  the  results  from  the  experiment  and  the 
exploratory  work  produced  the  following  findings: 

•  There  was  a  significant  difference  (.025)  between 
Film  12  immediate  performance  posttest  scores  of 
the  aptitude  profile  groups.  Profile  2  performance 
scores  were  significantly  better  than  were  Profile 

3  performance  scores. 

•  On  Film  12  immediate  performance,  men  who  received 
Strategy  3  (Practice)  performed  significantly 
better  than  men  who  received  Strategy  1 
(Independent  Study). 

•  On  written  tests,  main  effects  for  aptitude  profile 
revealed  that  Profile  Group  1  performed  signifi¬ 
cantly  better  than  Profile  Group  3.  In  some  cases, 
Profile  2  also  performed  significantly  better  than 
Profile  3. 

•  Although  general  ability  had  a  powerful  influence 
on  REDEYE  performance,  it  did  not  emerge  as  a 
clearcut  factor  to  characterize  existing  REDEYE 
gunners.  Instead,  a  more  specialized  and 
non-verbal  intellectual  ability  (spatial-analytic 
ability)  was  the  most  important  factor. 

•  When  the  masking  effects  of  general  ability  were 
taken  into  consideration,  the  best  predictor  of 
REDEYE  performance  was  the  ability  to  work  under 
stress . 
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•  An  important  factor  which  emerged  to  characterize 
this  population  was  the  "happy-go-lucky, 
venturesome,  outgoing"  factor.  This  factor  was 
also  within  the  top  three  predictors  for  REDEYE 
performance.  Elements  of  this  factor  also  proved 
to  be  important  in  both  the  CHAPARRAL  and  VULCAN 
samples . 

•  The  resales  of  the  exploratory  analyses  confirmed 
the  existence  of  the  aptitude  profiles  established 
for  the  first  part  of  the  REDEYE  study. 

Phase  II  resulted  in  the  following  findings: 

•  Intellectual  ability  emerged  as  a  specialized 
non-verbal  ability  (analytic  ability)  in  the 
CHAPARRAL  sample.  However,  it  split  into  both  a 
general  factor  and  a  specialized  one  (spatial- 
analytic)  in  the  VULCAN  sample. 

•  The  "ability  to  work  under  stress"  factor  was  the 
most  important  factor  in  surviving  VULCAN  training, 
but  it  was  not  as  predictive  of  performance  as  was 
the  "anxiety"  factor  or  the  "outgoing,  happy-go- 
lucky"  factor. 

•  The  "ability  to  work  under  stress"  factor  was  one 
of  the  three  most  important  factors  to  characterize 
those  who  complete  CHAPARRAL  training,  yet  it  did 
not  predict  CHAPARRAL  performance  at  all. 

•  Even  after  taking  into  consideration  the  masking 
effects  of  general  ability,  the  best  predictor  of 
CHAPARRAL  performance  was  the  analytic  factor. 


Conclusions 


•  The  aptitude  profile  combinations  identified  in  the 
REDEYE  sample  were  not  completely  general izable  to 
either  CHAPARRAL  or  VULCAN. 

•  Profile  3  was  an  important  profile  to  all  three 
tasks  and  was  generalizable .  Profile  2  was 
generalizable  to  REDEYE  and  VULCAN  only.  Profile  1 
was  meaningful  in  the  context  of  REDEYE  only. 

•  Profiles  were  apparently  learned  and  reinforced  by 
the  nature  of  the  task  and  the  training 
environment.  REDEYE  profiles  were  more  pronounced 
after  individuals  had  been  in  the  task,  than  while 
they  were  learning  the  task.  (Compare  to  the 
original  study:  Hebein,  1978;  Sullivan  et  al., 

1978.  ) 
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•  All  samples  had  many  factors  in  common  which  varied 
in  both  strength  and  in  relative  predictive 

abi 1 ity . 

•  The  three  greatest  predictors  of  successful 
completion  of  training,  regardless  of  sample,  were 
"spatial-analytic/analytic/general  ability, " 
"ability  to  work  under  stress,"  and  "anxiety." 
Although  they  vary  in  importance  from  sample  to 
sample,  they  were  always  the  first  three  in  the 
factor  analysis . 

•  The  one  obvious  difference  between  REDEYE  and  the 
other  two  tasks  is  that  REDEYE  is  an  individual 
task  and  the  other  two  are  team  tasks.  VULCAN 
requires  a  team  of  four  and  CHAPARRAL  has  a  team  of 
five.  There  is  no  other  obvious  difference  in  the 
task  components.  Levels  of  visual,  tactile,  and 
sequential  discrimination  seem  similar.  In  the 
individual  task,  ability  to  perform  training  tasks 
was  more  influenced  by  the  "ability  to  work  under 
stress"  than  in  team  tasks. 

•  "Anxiety"  was  a  less  important  predictor  with 
experienced  individual  task  performers  than  with 
team  task  trainees. 

•  The  most  frequent  personality  factors  influencing 
both  training  and  training  performance  were  the 
happy-go-lucky  and  conscientious  dimensions  from 
the  Cattell  16PF.  At  least  one  of  these  survived 
into  the  canonical  analysis  in  every  case. 

•  The  "ability  to  work  under  stress"  and  "anxiety" 
separated  into  two  distinct  factors  in  all  three 
samples . 
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CHAPTER  II 


INTRODUCTION  AND  BACKGROUND 


Overview 

The  technical  objective  of  the  research  program  was  "to 
expand  on  current,  successful  research  efforts  in  the 
application  of  population  specific  instructional  strategies 
by  determining  the  generalizability  of  present  categories  of 
trainee  population  characteristics  and  by  analyzing  training 
specifications  of  existing  SHORAD  weapons  systems  as  a 
function  of  existing  population  characteristics  and 
specified  instructional  strategies." 

There  has  been  (Tallmadge  &  Shearer,  1971)  and  there  is 
now  (Bloedorn,  1979;  Federico,  1978;  Hebein,  1978;  Mikes, 
1980;  Sullivan  et.  al .  ,  1978)  a  growing  body  of  literature 
which  seeks  to  explain  and/or  to  recommend  a  methodology 
that  will  help  to  explain  interactive  effects  between 
different  learner  characteristics  and  alternative 
instructional  methods  as  they  relate  to  task  performance  in 
a  military  setting.  The  current  effort  grew  out  of  earlier 
successful  contract  work  which  provided  the  impetus  for  this 
extension.  The  contractor's  three-phase  series  of  studies 
(Hebein,  1978;  Sullivan  et  al.,  1978)  made  a  beginning  with 
respect  to  the  use  of  a  viable  methodology  for  the  design 
and  implementation  of  alternative  instructional  strategies 
using  a  variation  of  the  aptitude  x  treatment  interaction 
(ATI)  approach. 

In  that  series  of  studies,  the  relationships  between 
specific  aptitude  profiles,  instructional  strategies 
designed  to  match  those  profiles,  and  acquisition  of  the 
REDEYE  missile  engagement  task  were  investigated.  Research 
about  single  aptitudes  and  single  features  of  instructional 
strategies  was  synthesized  to  develop  unique  strategies 
which  combined  elements  of  several  methods  in  order  to  match 
to  the  predominant  characteristics  of  the  identified 
profiles . 

At  the  completion  of  that  research  program,  it  was 
recommended  (1)  that  an  attempt  be  made  to  isolate  other 
combinations  of  aptitudes  (profiles)  which  might  explain 
differences  in  performance,  (2)  that  the  existence  of  the 
identified  profiles  be  confirmed  with  a  larger  sample  size 
and  in  other  parts  of  the  Army  trainee  population,  and  (3) 
that  a  similar  study  be  conducted  with  a  task  that  would  be 
somewhat  different  than  the  REDEYE  engagement  task. 

The  present  study  was  designed  to  follow  those 
recommendations  as  an  extension  of  the  earlier  work. 

Because  of  the  complex  nature  of  the  approach  and  because  of 
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the  differences  between  the  various  phases  of  this  study,  a 
separate  explanation  will  be  given  for  each  phase  to  clarify 
the  purposes  and  to  focus  the  contributions  of  that  phase  to 
the  overall  purposes  of  the  entire  research  program. 

In  this  study,  compared  to  the  earlier  contract  work 
(Hebein,  1978;  Sullivan  et  al . ,  1978),  there  were  some 
changes  aimed  at  improving  the  capability  for  discriminating 
soldier  aptitude  profile  patterns  and  at  increasing  the 
genera  1 izabi 1 i tv  of  this  approach  to  ATI  research.  The  use 
of  an  expanded  aptitude  test  battery  during  the  field 
portions  of  the  research  program  contributed  towards 
improved  aptitude  profile  discrimination.  The  extension  to 
refresher  training  from  initial  training  and  the  extension 
to  team  as  well  as  individual  tasks  for  other  Air  Defense 
systems  contributed  to  increased  generalizability  for  the 
approach . 

If  it  could  be  said  with  confidence  that  this  approach 
worked,  there  would  then  be  a  useful  model  with  which  to 
generate  instructional  strategies  that  would  be  related  to 
both  critical  performance  tasks  and  to  characteristics  of 
those  who  must  perform  those  tasks.  In  addition,  there 
would  be  a  reliable  way  to  categorize  people  based  on  unique 
aptitude  profiles.  With  such  information  in  hand,  military 
trainers  would  be  better  able  to  improve  the  quality  and 
effectiveness  of  all  levels  of  Army  training. 

ATI  Research 

ATI  is  an  approach  to  research,  not  an  area  of  research 
in  and  of  itself,  which  holds  particular  promise.  If  it  is 
successful,  students  could  be  differentially  assigned  to 
alternative  instructional  treatments  based  upon  empirical 
evidence  regarding  the  match  of  individual  characteristics 
with  designated  instructional  strategies  (Berliner  &  Cahen, 
1973;  Cronbach  &  Snow,  1977).  It  is  implicit  in  ATI 
research  that  there  is  no  one  best  way  to  instruct  the 
majority  of  people.  The  whole  movement  for  individualized 
instruction  is  a  testimonial  to  the  intuitive  sense  that  the 
concept  implies. 

If  trainer  developers  can  tailor-make  instructional 
methods  to  match  particular  aptitude  profiles,  then  soldiers 
or  trainees  who  might  not  do  as  well  in  traditionally 
selective  programs  could  now  have  the  opportunity  to  acquire 
the  material  more  completely.  ATI  applications  will  not 
reduce  individual  differences;  instead  they  will  help  to 
capitalize  on  them  for  the  benefit  of  the  learners. 

It  would  be  redundant  to  repeat  an  exhaustive  review  of 
ATI  literature  in  this  report.  The  reader  is  referred  to 
the  earlier  contract  studies  already  cited  and  to  Mikos 
(1980)  for  thorough  discussions  of  the  state-of-the-art  in 
ATI  research  and  how  it  relates  to  the  present  approach, 
which  is  an  extension  of  the  basic  ATI  model. 
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Instructional  Strategy  Development 


Sufficient  documentation  that  gives  a  rationale  for  and 
explains  the  exact  nature  of  instructional  strategies  or 
treatments  has  often  been  lacking  in  educational  and 
training  research.  To  design  treatments  for  use  in 
instructional  research  or  practice  is  no  easy  task,  and 
there  is  a  paucity  of  literature  on  the  specification  of 
treatments.  Carrier  (n.d.)  synthesized  an  interesting 
review  on  the  topic,  giving  many  practical  suggestions  on 
how  to  conceptualize  treatments.  She  pointed  out  that  the 
major  criticism  of  instructional  research  has  to  do  with 
this  basic  lack  of  understanding  about  what  constitutes 
treatments.  An  effort  was  made  in  this  study  to  answer  that 
criticism. 


Eight  different  treatment  dimensions  were  identified 
and  manipulated  to  a  greater  or  lesser  degree  in  the 
strategies  developed  for  this  effort.  It  was  not  an  all- 
encompassing  list  but  these  dimensions  represented  probably 
the  most  salient  features  of  any  treatment.  The  eight 
features  were  (not  necessarily  in  order  of  importance): 
group  vs.  individual  instruction,  presentation  nodes, 
practice,  motivation  (which  included  social  orientation  and 
social  interaction),  feedback  (a  special  case  of 
reinforcement),  pacing,  sequence  of  presentation  modes,  and 
structure.  See  Mikos  (1980)  for  a  detailed  discussion  of 
the  literature  concerning  each  feature,  and  Appendix  A  for  a 
more  detailed  explanation  of  the  values  for  each  dimension 
that  were  utilized  in  this  study.  The  descriptions  for  the 
strategies  given  in  the  present  report  supersede  those 
documented  by  Sullivan  et  al.  (1978)  and  are  an  extension  of 
the  earlier  work.  These  descriptions  are  also  discussed  in 
Chapter  III . 


There  are  several  sets  of  variables  that  can  enter  into 
the  design  and  development  of  instructional  strategies.  Any 
instructional  strategy  could  be  classified  over  a  host  of 
different  dimensions,  some  of  which  refer  to  the 
presentation  itself  and  others  of  which  refer  to  the  content 
of  the  presentation.  There  are  other  variables  that  relate 
to  the  kinds  of  skills  and  knowledges  that  are  necessary  to 
perform  the  task.  Still  other  variables,  which  are  always 
present  in  the  situation,  are  those  that  describe  the 
individual  learner  characteristics.  When  thinking  about  all 
these  treatment,  task,  and  individual  variables,  one  can 
easily  see  that  even  though  they  are  not  part  of  an 
exhaustive  list,  any  cross-product  would  result  in  an 
unmanageable  universe. 

In  the  search  for  some  practical  application,  some 
organized  restrictions  must  be  placed  on  each  set  of 
variables  and  combinations  thereof.  For  this  research,  the 
set  of  individual  variables  were  limited  to  some  degree  by 
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the  particular  tasks  studied.  The  variables  that  describe 
the  kind  of  information  to  be  learned  were  limited  somewhat 
by  the  choice  of  tests  in  the  aptitude  battery.  The 
treatment  variables  were  limited  by  the  research  uncovered 
on  instructional  strategies  for  people  with  the  particular 
aptitudes  of  interest  in  this  study.  The  design  of  the 
strategies  included  primarily  those  manipulable  features 
that  received  support  in  the  literature  for  people  with 
varying  levels  of  the  aptitudes. 

Since  the  aptitude  profiles  consisted  of  more  than  one 
aptitude,  there  was  a  greater  chance  to  locate  research  on 
strategies  that  related  to  at  least  part  of  the  profile.  In 
addition,  the  research  located  encompassed  several 
dimensions  of  the  instructional  strategies  allowing  for  more 
representativeness  of  treatment  in  a  field  situation.  Most 
research  methods  tend  to  maximize  the  effect  of  the  variable 
being  measured  by  randomizing  other  variables.  While  that 
may  be  good  research,  it  limits  genera lizabil ity 
cons iderabl y . 

Postman  (1961,  p.  71)  said  that  "theoretical  progress 
continues  to  come  through  eclectic  accretion."  The  present 
combination  of  dimensions  approach  (for  both  treatments  and 
aptitudes)  can  be  categorized  as  eclectic  accretion.  It 
also  coincides  with  the  ideas  of  Gagne  and  White  (1978),  who 
have  found  many  examples  of  improved  retention  and  transfer 
when  combinations  of  memory  structures  (networks  or 
propositions,  intellectual  skills,  images,  and  episodes)  are 
utilized  instead  of  a  single  structure. 

In  Hebein  (1978)  and  Sullivan  et  al.  (1978),  materials 
were  developed  and  implemented  that  either  capitalized  on 
high  abilities  characterizing  those  with  a  particular 
aptitude  profile  or  that  compensated  for  or  remediated  the 
low  abilities  characterizing  soldiers  with  a  different 
profile.  Such  preferential,  compensatory  and/or  remedial 
treatments  were  fashioned  after  the  model  by  Salomon  (1972) 
and  heed  the  advice  of  Cronbach  and  Snow  (1977)  to 
coordinate  several  capitalization  and  compensation  devices 
within  treatments. 

In  the  early  studies  and  the  present  study,  the 
investigators  also  utilized  the  "task  first"  approach  of 
Rhetts  (1974)  both  to  choose  aptitude  measures  and  to 
determine  appropriate  instructional  strategies.  Rhetts' 
approach  is  in  concert  with  the  idea  of  process  analysis, 
advocated  by  Cronbach  and  Snow  (1977),  and  with  that  of 
Fleishman  (1972,  1975)  who  has  worked  out  a  taxonomy  of 
instructional  situations  for  psychomotor  tasks.  The 
taxonomy  considers  a  multitude  of  dimensions,  including  the 
stimulus  properties  of  the  task,  instructor  characteristics, 
the  instructional  displays,  and  the  conditions  of  practice 
and  reinforcement. 
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The  general  thrust  of  instructional  strategy 
development  for  the  various  phases  of  this  study  began  by 
synthesizing  information  from  the  instructional  design 
literature  and  available  research  concerning  the  design  and 
prescription  of  specific  strategies.  The  goal  was  to 
establish  instructional  strategies  tailored  to  each  aptitude 
profile  identified  for  the  confirmatory  portion  of  the 
REDEYE  Study.  Particular  strategies  for  particular  levels 
of  the  following  aptitudes  were  reviewed:  cognitive  style, 
spatial  ability,  general  mental  ability,  and  anxiety.  While 
existing  theory  and  research  may  not  have  totally  definitive 
and  truly  generalizable  results,  there  are  some  guidelines 
that  appeared  to  work  to  a  reasonable  degree  in  this  study 
and  in  the  earlier  series  of  studies  (Hebein,  1978; 

Sullivan  et  al.,  1978). 

Numerous  references  about  instructional  strategies  for 
the  various  aptitudes  were  consulted.  Thorough  discussions 
of  these  sources  have  already  been  documented  elsewhere 
(Hebein,  1973;  Mikos,  1930;  Sullivan  et  al.,  1978).  For 
the  global/analytic  dimension  of  cognitive  style,  a  sampling 
cf  the  most  pertinent  literature  includes:  Eagle, 

Goldberger  &  Breitman  (1969);  Gooaenough  (1976);  Grieve  & 
Davis  (1971);  Guerrieri  (1978);  Retzke  (1976);  Rosenberg, 
Mintz,  &  Clark  (1977);  Witkin  et  al.  (1962);  and  Witkin  et 
al.  (1977). 

Carrier  &  Clark  (1977),  Clark  (1978),  Cronbach  &  Snow 
(1977),  Frandsen  &  Holder  (1969),  Gauverin  (1967a,  1967b), 
and  Hancock  (1975)  were  among  the  sources  synthesized  to 
develop  strategies  related  to  variations  in  spatial  ability. 
Concerning  instructional  strategies  and  general  mental 
ability,  the  reader  is  referred  to  .Mien  (1975),  Bialek, 
Taylor  &  Hauke  (1973),  Cronbach  &  Snow  (1977),  Hebein 
(1978),  Snow  (1976,  1977),  and  Taylor,  Montague  &  Hauke 
(1970).  Of  particular  value  when  developing  strategies  to 
account  for  anxiety  were:  Cronbach  &  Snow  (1977),  Gaudry  & 
Spielberger  (1971),  Sieber,  O'Neill  &  Tobias  (1977),  Snow 
(1977),  and  Spielberger  (1966). 

The  references  cited,  if  consulted,  will  provide  a 
wealth  of  suggestions  to  trainer  developers  concerning 
appropriate  strategies  to  use  for  learners  with  varying 
levels  of  these  aptitudes.  The  most  thorough  discussion  of 
these  references,  and  others,  can  be  read  in  Mikos  (1980). 
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CHAPTER  III 


REDEYE  STUDY 


REDEYE  is  a  man  portable,  shoulder  fired,  infrared- 
seeking  guided  missile  system  designed  to  provide  air 
defense  for  forward  combat  elements  and  other  assets 
against  low  altitude  hostile  aircraft  (TRASANA,  1977). 
Recent  studies  by  the  U.S.  Army  (TRASANA,  1976,  1977) 

indicate  that  REDEYE  gunner  proficiency  is  deficient  in 
several  areas  at  the  completion  of  Advanced  Individual 
Training  (AIT).  In  addition,  skill  in  these  tasks  declines 
quite  rapidly  after  initial  training  and  air  defense  unit 
proficiency  in  these  same  tasks  is  generally  quite  low. 

Given  the  above  situation,  the  original  hypothesis  for 
earlier  contract  studies  (Hebein,  1978;  Sullivan  et  al. , 
1978),  as  it  related  to  initial  training  of  REDEYE 
employment  and  engagement,  was  that  an  analysis  of  the 
cognitive  processes  and/or  the  perceptual  processes 
operating  during  target  acquisition,  tracking,  and 
engagement  decision  making  would  provide  a  reasonable  basis 
upon  which  to  structure  alternative  instructional 
strategies.  For  this  study,  that  original  hypothesis  was 
extended  to  refer  to  refresher  training  on  the  same  task. 

Based  on  a  review  of  the  research  and  a  process 
analysis  of  the  task  to  include  the  1978  series  of  studies 
under  contract,  certain  psychological  factors  were 
identified  that  related  to  criterion  performance.  These 
included  intellectual  ability,  cognitive  style,  two 
dimensional  perception,  and  the  personality  factor  of 
anxiety.  The  implications  for  instruction  for  people  with 
differing  levels  of  these  factors  were  then  studied  and 
synthesized  to  develop  alternative  instructional  strategies 
that  were  hypothesized  to  interact  with  the  trainees' 
characteristics  with  respect  to  successful/unsuccessful 
performance  on  this  complex  procedural  psychomotor  learning 
task . 


The  purpose  of  the  (Phase  I)  REDEYE  study  was  to 
investigate  the  effects  of  selected  instructional 
strategies  matched  to  learner  aptitude  profiles  which 
predict  criterion  performance  on  a  complex  procedural 
psychomotor  task  during  refresher  training.  This  was  done 
to  extend,  validate,  and  improve  earlier  contract  research. 
This  time  the  actual  target  population  was  used  rather  than 
one  that  was  only  similar  to  it. 

The  approach  taken  here  closely  parallelled  that  used 
in  the  1978  series  of  studies,  except  that  all  aspects  of 
the  research  were  refined  with  a  view  toward  improvement  and 
increased  generalizability .  This  was  accomplished  by  taking 
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i  two-pronged  approach  to  the  analysis.  The  first  was 
confirmatory  and  the  second  was  exploratory.  For  the 
former,  the  refresher  REDEYE  study  was  expected  to  confirm 
the  existence  of  those  aptitude  profiles  that  had  been 
identified  earlier  and  to  improve  upon  the  discrimination  of 
the  profiles  to  some  extent.  For  the  latter,  it  was 
expected  that  considerable  improvement  in  the  discrimination 
of  aptitude  profiles  might  be  achieved  through  the  analysis 
of  measures  in  the  expanded  test  battery  and  their  relations 
to  criterion  performance. 

In  this  chapter,  both  the  confirmatory  and  exploratory 
analyses  are  presented  and  explained.  For  a  pore  detailed 
discussion  of  the  confirmatory  portion  of  the  study  and  the 
theoretical  rationale  upon  which  it  was  based,  see  Mikos 
(1980).  For  a  more  complete  understanding  of  how  this 
research  has  evolved  from  its  inception,  see  Hebein  (1978) 
and  Sullivan  et  al.  (1978). 

Current  REDEYE  Refresher  Trainina 


Refresher  training  for  REDEYE  gunners  is  supposed  to  be 
conducted  at  regular  intervals  so  that  the  level  of  unit 
proficiency  can  be  optimal.  It  was  learned  early  in  this 
study  that  the  quality  and  quantity  of  REDEYE  refresher 
training  was  vastly  different  from  one  Continental  United 
States  (CONUS)  unit  to  another.  The  level  of  refresher 
training  often  seemed  to  be  a  function  of  the  personality  of 
the  company  commander,  the  squad  leader  or,  perhaps,  even 
the  base  commander  of  a  given  military  post.  More  often 
than  not,  even  when  there  was  a  Moving  Target  Simulator 
(MTS)  available  for  training,  most  units  did  not  receive  the 
amount  of  practice  recommended  by  TRASANA  (1977)  to  maintain 
acceptable  unit  proficiency. 

Regardless  of  the  amount  or  kind  of  refresher  training 
that  was  conducted,  there  appeared  to  be  no  real  standard 
that  was  universally  operable — at  least  not  at  the  four 
sites  at  which  the  study  was  conducted.  Even  Ft.  Bliss, 
where  the  Air  Defense  School  is  located,  did  not  have  a 
clearly  identifiable  refresher  REDEYE  training  program.  Ft. 
Bragg  appeared  to  be  the  only  site  where  a  consistent 
program  of  refresher  training  was  available. 

It  was  not  the  purpose  of  this  research  to  evaluate  any 
current  REDEYE  refresher  training.  It  was  necessary  to 
analyze  existing  REDEYE  refresher  training,  though,  in  order 
to  conduct  the  research.  Because  of  the  investigators' 
observations  about  current  refresher  U.S.  Army  training,  the 
results  of  this  study  may  have  even  more  important 
implications  than  originally  expected.  The  length  of  time 
for  the  refresher  training  conducted  for  any  of  the 
strategies  in  this  study  was  relatively  short.  This  would 
appear  to  be  an  advantage,  given  that  present  Army  practices 
typically  devote  little  time  to  refresher  training. 
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Methodology 


This  section  describes  the  population  for  the  study, 
the  measuring  instruments  for  the  aptitudes  that  determined 
the  aptitude  profiles,  the  aptitude  profiles  themselves,  the 
strategies  developed,  the  learning  task,  the  instrumentation 
and  field  procedures  for  the  study,  the  research  design,  and 
the  statistical  analysis  of  the  data. 

The  Population 

The  sample  population  consisted  of  102  military 
personnel  who  were  in  the  16P  MOS  (Military  Occupational 
Specialty)  as  air  defensemen,  specifically  as  REDEYE 
gunners.  The  target  population  was  the  entire  population  of 
REDEYE  gunners  in  the  U.S.  Army.  With  few  exceptions,  all 
of  those  in  the  sample  had  already  had  Advanced  Individual 
Training  (AIT)  or  its  equivalent,  in  the  performance  of  the 
REDEYE  task.  All  were  slated  to  have  REDEYE  refresher 
training . 

The  sample  was  taken  from  REDEYE  gunners  at  Ft.  Carson, 
Colorado,  Ft.  3ragg,  North  Carolina,  Ft.  Riley,  Kansas,  and 
Ft.  Hoed,  Texas.  Each  fort  was  to  provide  20  subjects,  with 
the  exception  of  Fort  Riley,  which  was  to  provide  40 
subjects  in  2  groups  of  20  each.  For  various  reasons  (e.g., 
security  clearance  problems,  equipment  failure,  and  Company 
Commanders'  orders),  training  could  be  conducted  and 
complete  data  on  both  independent  and  immediate  dependent 
measures  could  be  collected  for  only  87  of  the  102  men  in 
the  sample.  The  others  had  to  be  eliminated  from  the  study 
( Appendix  B ) . 

Retention  data  on  written  and  performance  measures  were 
to  be  collected  on  the  same  87  subjects  approximately  30 
days  after  the  training  data  were  collected.  In  the  final 
analysis  there  were  61  subjects  from  whom  both  training  and 
retention  data  were  collected:  20  of  the  21  from  Ft. 

Carson,  13  of  the  16  from  Ft.  3ragg,  14  of  the  16  from  the 
first  group  at  Ft.  Riley,  0  of  the  14  from  the  second  group 
at  Ft.  Riley,  and  14  of  the  20  from  Ft.  Hood. 

Measuring  Instruments 

Three  of  the  measuring  instruments  used  in  the  study 
were  identical  to  those  used  by  Hebein  (1978)  and  Sullivan 
et  al.  (1978)  in  their  previous  research  that  identified  the 
aptitude  profiles  of  this  study  for  the  first  time.  The 
Group  Embedded  Figures  Test  (GEFT)  was  used  to  measure  the 
global  and  analytic  dimensions  of  cognitive  style  (Witkin  et 
al.,  1971).  The  Cattell  Sixteen  Personality  Factor 
Questionnaire  (16PF)  (Cattell,  Eber,  &  Tatsuoka,  1970)  was 
chosen  to  measure  the  personality  factors  of  anxiety  and 
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general  intelligence  level.  Factor  B  measures  intelligence 
and  Factor  Q4  was  a  measure  for  anxiety.  The  third  test  was 
the  test  of  Spatial  Relations  for  Two  Dimensions,  from  the 
Multiple  Aptitude  Tests  (Segel  &  Raskin,  1955/1959).  This 
test  measures  the  ability  to  see  and  understand  the 
arrangement  elements  of  a  visual  stimulus  pattern  when  the 
examinee's  body  is  the  primary  frame  of  reference. 

In  addition  to  the  four  measures  just  named,  there  were 
six  other  -  mts  in  the  battery  administered  to  the  soldiers. 
All  of  the  '  "extra"  tests  in  the  battery  were  to  be 
thoroughly  analyzed  after  the  confirmatory  portion  of  the 
study  was  completed.  Only  those  tests  from  the  "extra"  tests 
in  the  battery,  which  could  be  considered  alternate  measures 
of  the  four  original  measures  used  for  the  profile 
formation,  were  included  in  this  phase  of  analysis. 

Since  the  original  measures  for  anxiety  and  for 
intellectual  ability  from  the  16PF  were  based  on  only  six 
and  eight  items  respectively,  and  in  spite  of  the 
demonstrated  validity  and  reliability  of  the  16PF,  it  was 
reasoned  that  it  might  be  wise  to  get  an  additional  measure 
based  on  a  larger  set  of  items  for  each  construct.  For  this 
reason,  the  State-Trait  Anxiety  Inventory  (STAI) 
(Spielberger  et  al.,  1970)  was  administered  for  anxiety. 

The  Thurstone  Test  of  Mental  Alertness  (Thurstone  & 
T'nurstor.e,  1952)  was  the  additional  measure  for  general 
ability . 

The  STAI  is  considered  one  of  the  best  standardized 
measures  of  anxiety,  if  not  the  best,  as  the  reliabilities 
are  nearly  as  high  as  one  would  expect  for  intelligence 
scales  (Dreger;  in  Buros,  1978).  For  the  confirmatory 
portion  of  the  analysis,  the  score  for  the  trait  anxiety 
scale  was  used  as  an  alternate  measure  of  Q4  from  the  16PF. 

The  Thurstone  Test  of  Mental  Alertness  (TMA)  was  chosen 
because  it  has  a  testing  time  of  only  20  minutes  and  can  be 
administered  to  a  group.  Besides  being  a  test  of  general 
ability,  "it  is  designed  to  measure  the  capacity  of  an 
individual  to  acquire  new  knowledge  and  skills  and  to  use 
these  in  problem  solving.  It  assesses  *"he  ability  to 
respond  quickly  and  accurately  to  question  situations  of 
alternating  problem  types"  (Thurstone  &  Thurstone,  1968). 

The  test  yields  a  language  score,  a  quantitative  score  and  a 
total  score.  For  the  confirmatory  analysis,  the  total  score 
on  the  TMA  was  used  as  an  alternate  measure  of  FB  from  the 
16PF . 

Two  measures  were  used  in  the  battery  for  the  purpose 
of  checking  their  relationship  with  field-dependence/ 
independence.  These  were  Closure  Speed  and  Closure 
Flexibility.  The  Closure  Speed  test  was  designed  to  measure 
Thurstone' s  "first  closure  factor,"  which  "is  defined  as  the 
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ability  to  perceive  -an  apparently  disorganized  or  unrelated 
group  of  parts  as  a  meaningful  whole,  i.e.,  the  capacity  to 
construct  a  whole  picture  from  incomplete  or  limited 
material"  (Thurstone  &  Jeffrey,  1966,  p.  1).  It  may  also  be 
a  component  of  cognitive  style  (Ekstrom  et  al.,  1976). 

The  other  test,  Closure  Flexibility,  is  designed  to 
measure  Thurstone' s  "second  closure  factor,"  which  "is 
defined  as  the  ability  to  hold  a  conf iguratior.  in  mind 
despite  distraction.  It  is  the  capacity  to  see  a  given, 
conf igurat ion  (diagram,  drawing  or  figure)  which  is  'hidden' 
or  embedded  in  a  larger,  tore  complex  drawing,  diagram,  or 
figure"  (Thurstone  &  Jeffrey,  1965,  p.  1).  Ekstrom  et  al. 
(1976)  think  that  Closure  Flexibility  too  is  related  to 
"field-independence."  Because  of  its  high  correlation  with 
the  GEFT  in  this  study  (.77),  it  was  used  as  an  alternate 
measure  for  field  independence/dependence. 

The  fifth  "extra"  test  was  the  Pursuit  subtest  from  the 
MacQuarrie  Test  for  Mechanical  Ability  (MacQuarrie, 
1925/1953).  This  is  one  of  a  series  of  subtests  to  measure 
aptitudes  which  underlie  successful  performance  on  a  wide 
variety  of  jobs  of  a  mechanical  nature.  This  particular 
subtest  is  somewhat  related  to  a  factor  called  spatial 
scanning,  which  is  defined  as  speed  in  exploring  visually  a 
wide  or  complicated  spatial  field  (Ekstrom  et  al.,  1976; 
MacQuarrie,  1925).  For  the  confirmatory  analysis,  the 
Pursuit  Test  was  used  as  an  alternate  measure  for  the 
Two-Dimensional  Spatial  Relations  Test  because  of  the 
significant  correlation  between  the  two  measures. 

The  last  test  of  the  battery  was  the  Press  Test.  The 
Press  Test  ( Baehr  and  Corsini,  1965)  was  adapted  from  the 
early  Stroop  Test  (Thurstone  &  Mellinaer,  1953)  which 
measured  interference  in  serial  verbal  reactions.  The  Press 
Test  has  a  word  naming  score,  a  color-naming  score,  and  a 
color-naming  with  distraction  score.  It  is  designed  to 
measure  the  ability  to  work  under  stress. 


Aptitude  Profile  Groups 


Four  aptitude  profile  groups  were  identified, 
the  results  of  the  aptitude  measures  that  were  admi 
to  the  sample.  High  and  low  scores  on  the  measures 
identify  those  who  fit  particular  aptitude  profiles 
operationally  defined  as  those  that  were  plus  or  mi 
standard  deviation  units  from  the  mean.  These  inci 
approximately  the  top  or  bottom  27%  of  scores  for  e 
measure . 
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Individuals  with  Aptitude  Profile  1  were  those  who 
scored  high  on  either  the  GEFT  (greater  than  or  equal  to 
or  on  Closure  Flexibility  (greater  than  or  equal  to  60), 
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they  scored  high  (greater  than  or  equal  to  5)  on  FB 
( Intelligence)  of  the  16PF  or  high  (greater  than  or  equal  to 
51)  on  the  Total  Thurstone.  Such  individuals  can  be 
described  as  field-independent  (analytic)  and  of  high 
general  intelligence. 

The  group  with  Aptitude  Profile  2  included  all  those 
who  scored  high  on  either  the  Two-Dimensional  Perception 
portion  of  the  MAT  or  on  the  MacQuarrie  Pursuit  Test  and 
scored  high  on  Factor  Q4  ( tense- relaxed ;  i.e.,  anxiety 
level)  of  the  16PF  or  on  the  Trait  scale  of  the  STAI . 
Individuals  in  this  group  can  be  characterized  as  being 
above  average  in  two-dimensional  perceptual  or  spatial 
ability  and  as  being  generally  anxious  persons  who  are  more 
likely  than  not  to  be  tense  and  to  perceive  a  situation 
(like  the  REDEYE  task)  as  threatening,  psychologically 
dangerous,  or  frightening  for  them.  Operationally,  those 
who  qualified  for  Profile  2  scored  greater  than  or  equal  to 
15  on  the  Two-Dimensional  Perceptual  Test  or  greater  than  or 
equal  to  24  on  the  Pursuit  Test  while  also  scoring  either 
greater  than  or  equal  to  6  on  Q4  of  the  16PF  or  greater  than 
|  or  equal  to  45  on  the  Trait  Scale  of  the  STAI . 

The  criteria  for  Aptitude  Profile  3  membership  was  as 
follows:  low  scores  on  either  the  GEFT  (less  than  or  equal 

to  4 )  or  on  Closure  Flexibility  (less  than  or  equal  to  22) 
and  on  Factor  B  of  the  16PF  (less  than  or  equal  to  3 )  or  on 
the  Total  Thurstone  (less  than  or  equal  to  29).  Such 
individuals  are  characterized  as  being  field-dependent 
(global)  and  of  low  general  intelligence. 

Any  individual  who  did  not  meet  the  criteria  for 
membership  in  one  of  the  identified  groups  was  placed  in 
Aptitude  Profile  Group  4.  This  group  represented  soldiers 
with  varying  combinations  of  the  measured  aptitudes  and  can 
be  considered  comparable  to  a  general  trainee  population. 
High  or  low  scores  on  a  measure  for  only  one  of  the 
constructs  needed  for  membership  in  one  of  the  other  profile 
groups  was  not  enough  to  warrant  inclusion  into  that  profile 
group.  It  was  the  combination  of  aptitudes  that  determined 
a  profile  and  not  any  one  aptitude  alone. 

It  was  possible  for  the  same  person  to  qualify  for 
membership  in  Profile  Group  1  and  Profile  Group  2  at  the 
same  time.  If  that  happened,  the  individual  was  assigned  to 
Group  2  because  it  was  decided  that  the  high  anxiety  should 
be  considered  directly.  It  was  also  possible  to  qualify  for 
both  Profile  2  and  Profile  3  simultaneously.  If  that 
happened,  the  soldier  was  assigned  to  Profile  3.  It  was 
decided  that  the  low  intelligence  level  and  social 
orientation  of  the  global  individual  was  more  critical  to 
consider  than  were  the  characteristics  of  Profile  2.  There 
t  was  no  possibility  for  anyone  to  qualify  for  both  Aptitude 

Profiles  1  and  3. 
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For  the  training  portion  of  this  study,  there  were 
eight  soldiers  who  had  both  Profile  1  and  2.  There  were 
four  men  who  qualified  for  both  Profile  2  and  3.  For  the 
reasons  described  already,  the  former  were  assigned  to 
Profile  2  and  the  latter  were  assigned  to  Profile  3.  The 
final  tally  for  each  Profile  included  16  with  Profile  1,  14 
with  Profile  2,  36  with  Profile  3,  and  21  with  Profile  4. 

In  the  retention  portion  of  the  study,  5  of  the  8  who 
qualified  for  both  Profile  1  and  2  were  lost,  while  1  of  the 
4  who  qualified  for  both  Profile  2  and  3  was  lost.  The 
final  count  for  the  retention  group  included  14  with  Profile 
1,  5  with  Profile  2,  28  with  Profile  3,  and  14  with  Profile 
4. 


Instructional  Strategies 

Based  on  specific  research  related  to  the  instruction 
of  learners  with  varying  levels  of  the  identified  aptitudes 
and  on  specific  instructional  design  principles  that  have 
been  identified  in  the  literature,  3  different  treatments, 
one  for  each  aptitude  profile,  fashioned  after  Hebein 
(1978)  and  Sullivan  et  al.,  (1978)  were  developed.  What 
follows  is  a  general  description  of  each  strategy.  See 
Appendix  A  for  a  detailed  description,  in  outline  form,  of 
each  strategy.  In  each  of  the  detailed  descriptions,  the 
variations  for  the  eight  treatment  dimensions  are  discussed. 
See  Table  1  for  a  summary  of  the  major  features  of  each 
strategy . 

Strategy  1  was  designed  specifically  for  people  who  are 
characterized  by  the  combination  of  aptitudes  that  made  up 
Aptitude  Profile  1.  As  a  result  of  the  literature  review  on 
field-independent  subjects  and  on  learners  of  high  general 
ability,  Treatment  1  was  designed  as  self-paced  independent 
study.  It  included  both  printed  and  visual  information  in  a 
self-paced  packet.  This  was  followed  by  mental  practice  in 
the  form  of  observation  of  others  and  actual  physical 
practice  if  and  when  the  student  thought  he  was  ready  and 
wanted  it  before  testing.  There  was  little  or  no  extrinsic 
feedback  with  intrinsic  motivation  of  learners  inherent  in 
the  strategy. 

Strategy  2  was  designed  specifically  for  people  whi. 
have  been  shown  to  have  Aptitude  Profile  2.  Based  on  th“ 
research  for  individuals  high  in  two-dimensional  spatial 
ability,  predominantly  visual  materials  were  used  with  a 
minimum  of  printed  matter.  The  training  began  with  a  short 
(19  minute)  videotape  called  "Introduction  to  REDEYE,"  that 
highlighted  the  parts  of  the  weapon,  its  capabilities,  the 
sequence  of  steps  for  engagement  and  a  small  amount  of  Range 
Ring  Profile  information,  among  other  things. 
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The  printed  information  was  limited  to  a  few  key  words, 
especially  for  attention  directing,  since  attention 
directing  during  task  performance  is  particularly 
advantageous  for  highly  anxious  students.  The  visuals  were 
sequential  and  varied  from  simple  to  complex.  The  learning 
materials  were  structured  in  order  to  deal  with  anxiety. 

The  soldiers  alternated  between  classroom  instruction  and 
instruction  in  the  simulator.  A  demonstration  and  a  brief 
chance  to  handle  the  weapon,  before  having  to  perform  with 
it  and  before  more  classroom  instruction  with  visual 
formats,  was  provided  in  order  to  keep  the  anxiety  level 
reduced  to  a  minimum.  Small  quizzes  dependent  on  the  visual 
materials  and  constructed  for  success  were  given.  These 
were  intended  to  capitalize  on  the  high  spatial  ability 
while  at  the  same  time  compensate  for  high  anxiety.  Actual 
practice  followed  the  end  of  the  last  visual  presentation, 
during  which  frequent  reinforcement  and  feedback  was  given 
in  a  supportive  fashion--all  in  an  effort  to  keep  the 
anxiety  down.  If  an  individual  was  not  doing  well  in 
practice,  he  was  told  what  was  wrong,  that  it  was  all  right 
to  make  a  mistake,  and  what  could  be  done  to  correct  any 
errors.  It  was  expected  that  the  supportive  reinforce¬ 
ment/feedback  from  the  investigator  would  engender  similar 
supportive  peer  group  interaction  during  practice.  This  was 
the  case  in  the  earlier  studies  and  in  this  one,  so  that  a 
friendly,  non- threatening  competition  was  present. 

Strategy  3  was  designed  specifically  for  people  with 
Aptitude  Profile  3--those  low  in  general  ability  who  are 
field-dependent.  Because  of  the  research  that  recommends 
active  response  for  low  ability  trainees  and  the  indications 
that  field-dependent  individuals  favor  interactive  teaching 
methods,  virtually  the  entire  strategy  relied  on  practice  of 
the  specific  task  with  instructor  and  peer  feedback.  There 
was  no  print  and  all  information  was  presented  verbally,  in 
small  steps,  at  a  simple  level.  There  were  very  few  visuals 
and  no  quizzes.  Because  global  individuals  are  likely  to 
rely  on  others'  opinions  to  guide  them  and  favor  inter¬ 
personal  and  social  contact  in  learning,  the  entire  group 
remained  together  during  the  treatment.  The  peer  group 
influence  was  encouraged  and  was  allowed  tc  generate  into 
fierce  competition  that  could  become  abusive  and  negative 
when  trainees  made  mistakes  during  practice--this  because 
the  field-dependent  individual  is  said  to  be  positively 
affected  by  negative  reinforcement.  Instructor  feedback  was 
generally  negative  or  non-supportive  and  no  effort  was  made 
to  explain  what  may  have  been  done  wrong  by  a  trainee  unless 
he  specifically  asked.  Then,  only  the  specific  question  was 
answered  and  nothing  else. 

Strategy  4  was,  in  a  sense,  a  control  group  for 
treatment  in  the  study  and  was  not  specifically  designed 
soldiers  with  this  "default"  profile.  It  consisted  of  a 
synthesis  of  the  current  regular  refresher  training  for 
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REDEYE  gunnels  as  it  is  presently  "supposed  to  be"  held  by 
the  Amy.  It  was  discovered  during  the  course  of  the  study 
that  a  good  deal  of  refresher  REDEYE  training  is  simply  not 
conducted,  which  helped  to  explain  the  low  unit  proficiency 
that  TRASANA  (1977)  found.  The  instructional  strategy 
relied  on  lecture  as  the  main  method  of  instruction,  in  the 
form  of  a  live  script  that  accompanied  a  slide  set.  There 
were  some  print  support  materials.  The  presentation  of  the 
material  was  structured  and  repetitious  with  a  good  deal  of 
verbal  information,  much  of  it  extraneous,  presented  with 
each  slide.  The  training  began  with  the  same  videotape  that 
was  presented  to  Profile  Group  2,  followed  by  the  verbally 
loaded  lecture'/ script  and  a  test  of  the  course  material.  A 
limited  amount  of  practice  was  given  as  the  final 
instructional  step. 

Learning  Task 

According  to  Rhetts  (1974),  it  is  only  after  the 
relevant  aspects  of  the  task  in  question  have  been 
identified,  that  one  can  identify  what  individual  difference 
measures  or  characteristics  are  related  to  performance  on 
the  task.  The  missile  engagement  task  in  this  study 
involved  a  series  of  procedural  steps  which  are  documented 
in  an  earlier  report  (Sullivan  et  al.,  1978)  and  will  not  be 
repeated  here. 

This  learning  task  was  a  complex  procedural  psvchomotor 
task  that  demanded  that  the  soldier  acquire  the  knowledge 
and  skills  to  successfully  perform  a  missile  engagement  task 
with  an  M49  Tracking  Head  Trainer  (the  training  model  for 
the  REDEYE  Guided  Missile  System)  while  in  the  Moving  Target 
Simulator  (MTS).  In  order  to  reach  criterion,  the  skills 
that  were  necessary  were:  (a)  visual  recognition,  (b) 

visual  discrimination,  (c)  rule  application,  (d)  eye-hand 
coordination,  (e)  tracking,  (f)  reaction  time,  (g)  response 
orientation,  and  (h)  rate  control.  All  of  these  skills  were 
used  in  order  to  successfully  perform  the  task--and  all  were 
documented  more  specifically  in  the  earlier  report  (Sullivan 
et  al. ,  1978)  . 

I  ns t rumen tat ion 


The  REDEYE  Moving  Target  Simulator  (MTS)  and  the 
Tracking  Head  Trainer  ( THT ) ,  as  shown  in  Appendix  C,  are 
used  to  simulate  tactical  air  defense  engagements  for 
training  gunners. 

The  MTS  projects  the  images  of  hostile 
aircraft  against  a  natural  sky  background 
with  3-channel  sound  effects.  Twelve  reels 
of  film  are  used  with  20  target  presentations 
per  reel.  Reels  1  through  10  contain 
progressively  more  difficult  presentations. 
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The  velocity  of  the  aircraft  may  be  up  to  650 
knots.  Reels  11  and  12  contain  aircraft  of 
all  performance  categories,  and  are 
representative  of  the  variety  of  targets  to 
be  engaged  by  the  tactical  REDEYE  Weapon 
System.  Detailed  descriptions  of  the  target 
aircraft  types  and  flight  parameters  for  each 
film  reel  are  confidential  (TRANSANA,  1977, 
p.  2-1)  [sic]. 

In  addition,  an  infrared  (IR)  spot  is  super impose  I  on 
each  moving  target  for  the  same  length  of  time  as  would  be 
detectable  if  it  were  the  heat  source  of  a  real  target.  The 
IR  can  be  detected  by  the  IR  sensor  in  the  THT  just  as  it 
would  be  in  an  actual  weapon,  allowing  the  gunner  to  track 
the  target. 

The  THT  is  a  full-scale  model  of  the  REDEYE  weapon 
system  that  is  ballasted  to  simulate  the  weight  of  the  fully 
loaded  REDEYE  Weapon  System  (about  28  pounds).  The  THT 
simulates  the  operating  characteristics  of  the  weapon  system 
from  activation  to  firing.  Just  as  in  a  tactical  situation, 
the  gunner  using  the  THT  has  only  31  seconds  from  the  time 
of  activation  to  complete  a  successful  firing  sequence  and 
launch.  Otherwise  the  battery  coolant  unit  will  run  out  of 
life  which  would  create  loss  of  IR  and  would  prevent  a 
successful  launch.  The  THT  looks  and  feels  almost  exactly 
like  the  REDEYE  Weapon  except  for  a  compressor  actuator 
assembly  (gas  pump  handle)  mounted  on  the  launch  tube,  a 
performance  indicator  assembly  that  is  under  the  gyro 
activator  coils  and  a  few  other  smaller  items.  The 
performance  indicator  gives  a  visual  indication  of 
sequential  errors  made  by  a  gunner  during  an  engagement 
sequence  (TRASANA,  1977). 

The  combination  of  the  MTS  and  the  THT  is  a  very 
sophisticated,  realistic,  and  effective  simulation  device. 

If  a  gunner  completes  the  firing  sequence  successfully,  a 
"beep"  tone  sounds  signifying  a  "hit."  If  an  error  in  the 
sequence  was  made,  which  was  not  corrected  before  pulling 
the  trigger,  a  "turkey-call"  tone  sounds  signifying  "error" 
at  the  moment  the  gunner  pulls  the  trigger. 

By  looking  at  the  performance  indicator  panel  before 
resetting  the  battery,  the  gunner  (and  the  instructor)  can 
see  which  step  or  steps  in  the  sequence  were  performed 
correctly  and  incorrectly.  Once  the  gunner  has  pulled  the 
trigger,  he  cannot  go  back  to  retrace  any  steps.  Before 
then,  he  can  make  corrective  actions  in  response  to  feedback 
from  the  system,  at  any  stage  of  the  sequence,  as  long  as  he 
does  so  within  the  31  second  life  of  the  battery  coolant 
unit . 
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By  recording  the  precise  performance  on  each  try  for  a 
launch  and  by  setting  values  on  each  part  of  the  sequence,  a 
score  for  each  try  can  be  obtained.  A  try  consists  of  all 
actions  from  one  trigger  pull  co  the  next  trigger  pull,  or 
if  the  trigger  is  never  pulled,  from  the  time  a  target  first 
appears  on  the  screen  to  when  it  disappears  completely,  not 
to  return.  There  is  a  time  lag  between  targets,  when  none 
are  projected.  This  is  necessary  so  that  the  mirror  system 
that  projects  the  IR  spot  can  position  itself  for  the  next 
target.  See  Appendix  C  for  the  point  values  used  in  scoring 
the  films  during  performance  testing  for  this  study. 

Field  Procedures 

The  experiment  was  conducted  at  five  different  times, 
one  for  each  scheduled  group  of  20  subjects  over  a  two-month 
period  by  the  investigators  and  several  assistants.  Too 
order  for  the  locations  was:  Ft.  Carson,  Ft.  Bragg,  Ft. 
Riley,  Ft.  Hood,  and:  Ft.  Riley  again.  The  procedures  ^t 
each  site  were  essentially  the  same  with  some  notable 
exceptions  that  are  detailed,  by  site,  in  Appendix  B.  The 
discussion  of  the  "typical"  experimental  situation  is  now 
presented . 

A  military  officer  accompanied  the  investigators  and 
assistants  to  all  sites  and  served  as  the  instructor  for 
Strategy  4.  In  addition,  the  officer  handled  all  on-site 
coordination . 

The  soldiers  were  tasked  for  two  consecutive  days  of 
training  by  their  commanders.  They  were  tasked  for  another 
training  da\  to  follow  30  days  after  the  first  two-day 
session.  Training  was  conducted  with  each  group  of  20  men 
independently  in  time  and  place  (except  for  the  two  nrounc 
am  Ft.  Riley)  from  the  other  groups.  The  groups  at  Riley 
were  nut  through  the  training  separately  in  time  from  one 
another . 

On  the  first  day  for  each  group,  the  men  were  randomly 
assigned  to  treatment.  The  training  was  conducted  according 
to  the  specif ications  already  developed  for  each  treatment 
and  documented  under  "Instructional  Strategies."  The  time 
required  for  the  training  varied  from  one  strategy  to 
another,  but  all  training  was  accomplished  within  4  hours  or 
less.  Performance  testing  in  the  simulator  was  done 
individually  or  two  at  a  time  and  took  approximately  two  to 
three  hours  total,  depending  on  how  well  the  equipment  was 
working.  Each  individual  soldier  experienced  testing  for 
only  a  few  minutes  in  the  simulator  on  two  different 
occasions.  Scoring  for  both  performance  measures  was 
tightly  controlled  to  insure  accurate  measurement. 
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During  performance  testing,  each  soldier  received  two 
passes  on  Film  10  and  was  encouraged  to  attempt  as  many  hits 
as  possible  on  each  pass,  as  long  as  time  allowed.  The 
targets  on  Film  10  were  of  constant  speed,  all  fast,  with 
considerable  evasive  action.  After  every  soldier  had 
completed  his  turn  on  Film  10,  the  same  procedures  were 
followed  with  Film  12.  The  targets  on  Film  12  represented 
the  full  range  of  targets  that  can  be  engaged  by  the  REDEYE 
Weapon  System,  both  in  performance  category,  speed,  and 
possible  evasive  action. 

After  ail  had  completed  the  performance  testing,  the 
entire  group  was  given  two  pencil  and  paper  instruments 
which  took  approximately  20-30  minutes  to  complete.  The 
first  was  given  while  still  in  the  simulator  and  was  a 
measure  of  State  Anxiety  (Form  X-l  of  the  STAI )  with  special 
instructions  that  asked  for  their  anxiety  state  while 
operating  the  THT  in  the  MTS.  This  was  collected  with  the 
intention  of  using  it  during  the  exploratory  analysis  phase 
to  refine  the  formation  of  profiles  for  the  future.  A 
written  test  on  the  Range  Ring  Profile  (RRP)  information  was 
then  given  in  an  adjoining  classroom.  The  RRP  test 
consisted  of  18  drawings  of  aircraft  within  range  rings. 

Each  drawing  called  for  three  different  responses— aircraf t 
size  and  type,  proportion  of  aircraft  to  range  ring,  and  a 
"fire/no  fire"  decision  based  on  the  target  being  within  the 
engagement  envelope.  After  that,  the  men  were  dismissed  for 
the  day. 


The  next  day,  aptitude  tests  were  administered  that 
were  intended  to  discriminate  the  aptitude  profile  groups. 
Total  testing  time,  including  directions  and  all  breaks  for 
each  group  was  approximately  three  hours.  The  testing  was 
done  in  the  morning  and  the  men  were  dismissed  as  soon  as 
they  finished  the  last  test.  The  order  of  administration 
for  the  aptitude  tests  was  determined  by  means  of  a  random 
number  table. 

Approximately  one  month  later,  retention  data  was 
collected  on  both  the  performance  (Films  10  and  12)  and  the 
written  (Range  Ring  Profile)  portions  of  the  task.  During 
the  interval  between  the  training/ testing  period  and  the 
retention  testing  none  of  the  subjects  participated  in  any 
other  REDEYE  refresher  training  nor  did  they  get  any 
practice  with  a  THT  in  the  MTS. 

Design  of  the  St"dy 

The  research  design  for  the  confirmatory  analysis  phase 
was  a  "Post  Test  Only-Control  Group  Design"  (Campbell  & 
Stanley,  1963)  with  some  subjects  from  all  aptitude  profile 
groups  (theoretically)  being  placed  in  all  four  strategy 
groups.  The  basic  design  was  extended  in  that  there  were 
two  posttests  for  each  dependent  variable:  one  immediately 
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following  training  and  the  other  approximately  one  month 
later  for  retention.  It  had  been  originally  intended  that  a 
crossed  design  be  used  that  would  guarantee  complete  random 
assignment  from  each  aptitude  profile  to  each  treatment 
group.  This  was  not  possible  because  of  subject 
availability  for  training  occurring  simultaneously  with 
availability  for  the  testing  designed  to  identify  the 
aptitude  profiles.  Instead,  subjects  were  randomly  assigned 
to  strategy  groups  (from  the  total  sample  population). 
Without  randomization  to  the  fully  crossed  design,  this 
confirmatory  portion  of  the  study  is  best  categorized  as 
quasi-experimental  research.  It  was  a  4  x  4  factorial 
design . 

Experimental  Variables 

The  confirmatory  phase  was  designed  to  measure  the 
interaction  between  two  independent  variables:  aptitude 
profile  groups  and  instructional  strategies.  There  were 
four  different  aptitude  profile  groups  whose  characteristics 
were  defined  by  scores  on  a  specific  set  of  aptitude 
measures.  There  were  also  four  strategies,  each  designed  to 
match  one  of  the  aptitude  profile  groups. 

The  exploratory  phase  was  designed  to  investigate  the 
relationships  between  individual  aptitudes  in  greater  detail 
ir.  an  effort  to  better  explain  the  profiles.  It  was  also 
designed  to  determine  what,  if  any,  other  composite  aptitude 
profiles  could  be  identified  that  would  improve  the 
prediction  for  criterion  performance  over  the  aptitude 
profiles  used  during  the  confirmatory  phase  of  the  analysis. 

Dependent  Variables 

The  three  dependent  variables  from  the  training  portion 
of  the  study  were  the  individual  scores  on  the  two 
performance  tests.  Film  10  and  Film  12,  and  the  score  on  the 
written  test  (Range  Ring  Profile).  There  were  three 
additional  dependent  variables  for  retention  that  were 
collected  approximately  30  days  after  training  at  each  fort. 
They  were  identical  tests  to  those  administered  during  the 
training  portion  of  the  study  except  for  when  they  were 
given.  They  could  be  called  Film  10  Retention  (Film  10R), 
Film  12  Retention  (Film  12R),  and  Range  Ring  Profile 
(written)  Retention  ( RRPR ) . 

Statistical  Analysis 

The  data  collected  for  the  confirmatory  portion  of  this 
study  were  analyzed  using  multiple  regression  analyses. 
According  to  Cronbach  and  Snow  (1977),  it  is  the  preferred 
method  of  statistical  analysis  for  ATI  studies. 

Furthermore,  in  the  case  of  unequal  cell  frequencies  in 
factorial  designs  with  categorical  variables,  the  multiple 
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regression  approach  is  called  for  in  order  to  appropriately 
partition  variance  that  is  confounded  by  correlations 
between  the  independent  variables  and  their  interactions 
(Kerlinger  &  Pedhazur,  1973).  The  a  priori  ordering 
approach,  with  effect  coding,  (Kerlinger  &  Pedhazur,  1973, 
pp.  193-196)  was  used  to  set  up  the  regression  analysis. 

The  stepwise  solution  with  the  following  hierarchical 
ordering  was  used:  all  interaction  terms  were  submitted  for 
analysis  first,  followed  by  all  coded  vectors  for  aptitude 
profile  at  the  next  inclusion  level,  and  then  all  coded 
vectors  for  instructional  strategy  at  the  last  inclusion 
level . 


For  the  exploratory  analysis,  no  categorical  aptitude 
profile  variable  was  used.  Instead,  the  individual  aptitude 
measures  from  the  entire  test  battery  were  submitted  to  a 
series  of  factor  analyses  which  were  intended  to  explain  the 
underlying  structure  upon  which  the  aptitude  profiles  were 
based.  In  addition,  several  canonical  correlation  analyses 
were  performed  in  order  to  investigate  the  relationships 
between  the  set  of  dependent  variables  and  the  set  of 
independent  variables.  The  end  result  of  canonical  analysis 
is  to  learn  how  the  composite  of  the  independent  variables 
is  most  related  to  the  composite  of  the  dependent  variables. 

No  particular  hypotheses  were  generated  to  be  subjected 
to  data  confirmation  in  this  exploratory  phase  of  analysis 
(or  in  the  exploratory  analyses  of  CHAPARRAL  and  VULCAN  data 
--Chapter  IV).  Because  of  this,  and  because  of  the  small 
number  of  data  points  in  each  sample  (REDEYE  n  =  61; 
CHAPARRAL  n  =  67;  VULCAN  n  =  61),  it  would  have  been 
inappropriate  to  perform  any  further  analyses  such  as 
redundancy  analyses  (Lindeman,  Merenda,  &  Gold,  1980;  Smith, 
1980). 


Twenty-eight  independent  variables  were  submitted  to 
the  first  factor  analysis.  These  included  all  measures 
listed  under  "Measuring  Instruments"  with  the  exception  of 
the  measure  for  the  Total  Thurstone  test.  The  principal 
component  solution  (principal  factoring  without  iteration) 
produced  an  orthogonal  factor  matrix  which  was  rotated  by 
the  varimax  method.  The  number  of  factors  was  unrestricted 
at  first.  Using  the  same  factoring  and  rotation  methods, 
the  same  variables  were  submitted  to  other  factor  analyses 
in  which  the  number  of  factors  was  restricted  to  four,  five, 
and  seven  factors.  The  results  of  a  scree  analysis 
(Cattell,  1966)  helped  to  determine  how  to  restrict  the 
number  of  factors  to  be  extracted.  Simple  structure 
analyses  were  then  performed  on  each  solution  in  order  to 
determine  the  most  meaningful  solution. 

The  total  Thurstone  was  eliminated  from  the  analysis 
because  it  provided  duplicate  information  that  was  already 
available  from  the  two  subtest  scores  (Quantitative  and 
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Language).  Also,  if  the  Total  Thurstone  had  been  retained 
for  the  factor  analysis,  it  would  have  produced  a  singular 
matrix,  which  is  undesirable  for  some  methods  of  factor 
analysis.  Since  this  was  an  exploratory  analysis  it  was 
quite  possible  that  more  than  one  method  of  factor  analysis 
or  of  rotation  of  factors  would  be  used.  If  there  was  a 
singular  matrix,  a  full  range  of  exploratory  analyses  would 
not  be  possible.  By  eliminating  the  Total  Thurstone  from 
all  factor  analyses,  one  could  be  confident  that  all 
analyses  were  based  on  exactly  the  same  data. 

All  analyses  were  performed  using  versions  H  and  M, 
release  8.0,  of  the  Statistical  Package  for  the  Social 
Sciences  (SPSS)  (Nie,  Hull,  Jenkins,  Steinbrenner ,  &  Bent, 
1975).  For  the  confirmatory  analyses,  Alpha  was  set  at  .05, 
and  significant  main  effects  were  tested  by  Fisher' s  Least 
Significant  Difference  (LSD)  Procedure,  (Kirk,  1968;  Nie  et 
al. ,  1975).  The  Fisher's  LSD  procedure  was  chosen  because 
it  is  exact  for  unequal  group  sizes.  For  the  exploratory 
factor  analyses,  interpretations  were  made  after  the 
completion  of  both  a  scree  analysis  and  several  simple 
structure  analyses,  all  of  which  were  done  by  hand. 
Principles  of  logic  were  applied  to  determine  the  final 
interpretation  of  factors.  This  interpretation  took  into 
consideration  the  differences  in  factor  structure  for 
different  numbers  of  restricted  factors,  but  placed  special 
emphasis  on  the  seven  factor  solution. 

Analysis  and  Results 

This  section  presents  a  descriptive  summary  of  the 
data,  the  results  of  the  multiple  regression  analyses,  the 
factor  analyses,  and  the  canonical  correlation  analyses. 
First  the  analysis  and  results  for  the  confirmatory  phase  of 
the  effort  is  presented.  Following  that  will  be  the 
analysis  and  results  of  the  exploratory  phase. 

Confirmatory  Analysis 

Analysis .  The  performance  test  (Films  10,  12,  10 
Retention,  and  12  Retention)  and  the  written  test  (Range 
Ring  Profile  and  Range  Ring  Profile  Retention)  scores  were 
analyzed  by  aptitude  profile  group,  instructional  strategy 
group,  and  aptitude  profile  x  instructional  strategy 
interaction  cell.  Table  2  reports  the  number  of  soldiers, 
means,  standard  deviations,  and  ranges  for  all  of  the 
dependent  measures  by  aptitude  profile.  In  this  table,  the 
named  statistics  are  reported  for  the  61  soldiers  from  whom 
there  was  complete  data  for  both  training  and  retention.  In 
addition,  the  same  table  reports  the  information  on  all  but 
retention  testing  for  the  87  soldiers  from  whom  there  was 
complete  training  data,  regardless  of  the  availability  of 
retention  data.  The  same  data:  number  of  soldiers,  means, 
standard  deviations,  and  ranges  are  presented  in  Table  3  for 
instructional  strategy  groups. 
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TABLE  2 


PERFORMANCE  ANT)  WRITTEN  TEST  MEANS,  STANDARD  DEVIATIONS,  .AND  RANGES 
FROM  TRAINING  .AND  RETENTION  FOR  APTITLDE  PROFILES 


Dependent 

Aptitude  Profile  1 

Aptitude  Profile  2 

Measures 

N  X  SD  Range 

N  X  SD  Range 

Film  10a 

16 

6.81 

3.23 

9 

14 

6.71 

4.56 

14 

Film  10° 

Film  10 

14 

7.36 

3.05 

9 

5 

6.60 

4.33 

13 

Retention 

14 

7 . 64 

2 . 5t> 

6 

5 

8.20 

1  .79 

4 

Film  12a 

IP 

11.19 

5.78 

23 

14 

15.00 

9.20 

33 

Film  12° 

Film  12  ^ 

14 

11.07 

6.15 

23 

5 

lb. 80 

7.69 

20 

Retention 

14 

10.29 

5.20 

20 

5 

8.^0 

2.30 

5 

RRP°  ’ C 

16 

38 . 88 

6.47 

27 

14 

38.79 

3.95 

15 

RRP° 

14 

39 . 29 

b .  S3 

27 

5 

39 . 80 

5.17 

13 

RRP°  Retention 

14 

41.21 

2.61 

9 

5 

39.20 

4 . 66 

13 

Dependent 

Aptitude 

Profile  3 

Aptitude  Profile  4 

Measures 

N  X 

SD  Range 

N  X  SD  Range 

Film  10a 

36 

5 . 86 

3.27 

10 

21 

6.67 

4.46 

IS 

Film  10° 

Film  10  k 

28 

5 . 54 

3.29 

10 

14 

5.79 

4.68 

18 

Retention 

28 

5.89 

3.70 

10 

14 

6.71 

3.24 

10 

Film  12a 

36 

9.36 

6.12 

29 

21 

12.76 

7.50 

29 

Film  12° 

Film  12 

28 

7.93 

5.15 

20 

14 

11.50 

7.50 

29 

Retention 

28 

11.50 

5.30 

25 

14 

10.00 

4.82 

21 

RRPj’C 

36 

32.44 

6.41 

26 

21 

33.29 

5.75 

24 

RRPb 

28 

33.18 

5.37 

21 

14 

35  .  14 

4.52 

18 

RRP  Retention 

23 

33.82 

5.36 

24 

14 

37.79 

6.22 

25 

aFrom  the  sample  of  87  soldiers  for  whom  there  was  complete 
training  data  regardless  of  availability  of  retention  data. 

°From  the  sample  of  61  soldiers  for  whom  there  was  complete  data 
tor  both  training  and  retention, 
c 

Range  Ring  Profile  Written  Test 
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TABLE  3 


PERFORMANCE  AND  WRITTEN  TEST  MEANS,  STANDARD  DEVIATIONS,  AND  RANGES 
FROM  TRAINING  AND  RETENTION  FOR  INSTRUCTIONAL  STRATEGY  GROUPS 


Dependent 

Strategy  1 

Strategy  2 

Measures 

N 

X 

sp 

Range 

V 

X 

SD  K. 

l!! 

Film  10* 

21 

7.29 

4.81 

18 

24 

6 . 08 

3.08 

10 

Film  10° 

Film  10 

15 

7.07 

4 . 9b 

18 

16 

5.81 

2.90 

10 

Retention 

15 

6.73 

3.22 

10 

16 

7.38 

3.05 

8 

Film  12? 

21 

11.76 

10.23 

37 

24 

10.00 

4.52 

20 

Film  12° 

Film  12 

15 

8.40 

8.03 

33 

16 

9.50 

4.93 

20 

Retention 

15 

10.00 

4.81 

21 

16 

10.44 

3.93 

15 

RRP*  ’ C 

21 

32.57 

6.93 

25 

24 

37.00 

5.55 

27 

RRP° 

15 

33.8  7 

6 . 85 

25 

1 6 

38.  13 

3.28 

1 1 

RRP  Retention 

15 

35.93 

6 . 65 

27 

16 

37.88 

3.52 

11 

Dependent 

Strategy  3 

Strategy  4 

Measures 

N 

X 

SD 

Range 

N 

X 

SD  Range 

Film  10* 

22 

7.14 

3.3b 

13 

20 

4.90 

3.43 

10 

Film  10 

Film  10 

14 

6.14 

3.35 

11 

16 

5 . 4a 

3.52 

10 

Retention 

14 

7.36 

2.84 

8 

16 

5.31 

3.75 

10 

Film  12* 

22 

13.59 

7.69 

25 

20 

10.40 

4.75 

17 

Film  12 

Film  12  b 

14 

12.93 

7.91 

25 

16 

10.19 

4.83 

17 

Retention 

14 

12.43 

6.31 

20 

16 

9.81 

4.82 

20 

RRP* ’ C 

22 

35.09 

5.98 

25 

20 

34.40 

7.34 

28 

RRP° 

14 

35.36 

5.40 

20 

16 

34.81 

7.51 

28 

RRP  Retention 

14 

37  .  14 

4.35 

15 

16 

36.50 

7.89 

25 

*From  the 

sample 

of  87 

soldiers 

for  whom 

there  was 

comp lete 

training  data  regardless  of  availability  of  retention  data. 


From  the  sample  of  61  soldiers  for  whom  there  was  complete  data 
for  both  training  and  retention. 

c 

Range  Ring  Profile  Written  Test 
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Tables  4  through  12  summarize  the  data  for  the  aptitude 
profile  x  treatment  cells  for  each  test.  Tables  4  and  5 
report  the  descriptive  information  on  Film  10  for  the  87 
cases  and  the  61  cases  respectively.  Table  6  presents  the 
information  for  Film  10  Retention.  The  descriptive  data  for 
Film  12  and  Film  12  Retention  for  87,  61,  and  61  subjects 
respectively,  is  presented  in  Tables  7  through  9.  Finally, 
Tables  10  through  12  complete  the  descriptive  interaction 
cell  reports  giving  the  data  on  the  Range  Ring  Profile 
Training  and  Retention  tests. 

Multiple  regression  analyses  w^re  performed  to 
determine  if  significant  interaction  or  main  effects  existed 
for  aptitude  profile  groups  and  instructional  strategy 
groups  on  both  immediate  and  retention  performance  and 
written  posttests.  For  the  three  immediate  posttests  only, 
separate  analyses  were  performed  for  each  of  the  following: 
(a)  all  subjects  for  whom  there  was  complete  training  data, 
regardless  of  the  availability  of  retention  data  (N  =  87), 
and  (b)  all  those  for  whom  there  was  complete  data  for  both 
immediate  and  retention  posttests  (N  =  61).  The  regression 
summary  tables  include  the  following  information:  (a)  the 

proportion  of  variance  explained  by  each  factor,  the 
interactions  between  factors,  and  the  residual,  (b)  the 
respective  sums  of  squares,  (c)  degrees  of  freedom,  (d)  mean 
squares,  (e)  the  observed  values  of  F,  and  (f)  the 
probability  levels  for  significance. 

Table  13  summarizes  the  results  of  the  multiple 
regression  analyses  of  aptitude  profile,  treatment,  and 
interactions  for  the  immediate  and  retention  performance 
posttests  of  Film  10  for  N  =  87,  N  =  61  and  N  =  61 
respectively.  None  of  the  observed  values  of  F  were 
significant  at  the  .05  level.  Consequently,  no  further 
analyses  of  Film  10  data  were  warranted. 

Table  14  contains  the  results  of  the  multiple 
regression  analyses  of  aptitude  profile,  instructional 
strategy,  and  interactions  for  the  immediate  and  retention 
performance  tests  of  Film  12  for  N  =  87,  N  =  61  and  N  =  61 
respectively.  For  the  87  subjects,  none  of  the  values  of  F 
were  significant  at  the  .05  level  but  the  observed  F  value 
for  Profile,  2.345,  approached  significance.  Since  none  of 
the  values  were  significant,  no  further  analyses  were 
appropriate.  When  the  same  analysis  was  performed  on  the  61 
subjects  who  had  both  immediate  and  retention  scores,  there 
were  significant  effects  (£  _<  .05)  for  both  instructional 
strategy  and  aptitude  profile,  but  not  for  their  interaction 
on  immediate  performance  data.  Since  strategy  and  profile 
were  significant,  further  analyses  were  performed  to  isolate 
where  the  significant  differences  were  occurring.  In  the 
analysis  of  the  retention  data  the  interaction  and  the  main 
effects  were  not  significant  and  no  further  analyses  of  the 
retention  data  were  conducted. 
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TABLE  4 


FILM  10  PERFORMANCE  TEST  MEANS  AND  STANDARD  DEVIATIONS  FOR 
APTITUDE  PROFILE  X  INSTRUCTIONAL  STRATEGY  CELL  (N  =  87) 


Aptitude 
Prof i  le 
Groups 

Instructional  Strategy  Groups 

Row  Totals 

1 

2 

3 

4 

X 

7.25 

4 . 60 

7.80 

9 . 00 

6.81 

1 

SD 

3.77 

2.88 

3.11 

1.41 

3.23 

n 

4 

5 

5 

2 

16 

X 

8.25 

8.50 

7.80 

1.67 

6.71 

"> 

SD 

6.05 

0.71 

2.17 

2.08 

4.56 

a 

*4 

■> 

5 

3 

14 

X 

5  .  oO 

5 . 54 

6.67 

5  .  t)7 

5  •  8b 

3 

SD 

4 . 04 

2.99 

3.57 

3.39 

3.27 

n 

5 

13 

9 

9 

36 

X 

7.88 

8.50 

6.33 

4.00 

6.67 

4 

SD 

5.  19 

3.00 

5.86 

3.03 

4 . 46 

n 

8 

4 

3 

6 

21 

Column 

X 

7.29 

6.08 

7.14 

4.90 

6.37 

Totals 

SD 

4.81 

3.08 

3.36 

3.43 

3.76 

n 

21 

24 

22 

20 

87 

t 
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TABLE  5 


FILM  10  PERFORMANCE  TEST  MEANS  AND  STANDARD  DEVIATIONS  FOR 
APTITUDE  PROFILE  X  INSTRUCTIONAL  STRATEGY  CELL  (N  =  61) 


Aptitude  Instructional  Strategy  Groups 


Profile 

Groups 

1 

2 

3 

■4 

Row  Totals 

X 

7.25 

5.25 

8.75 

9.00 

7.36 

i 

SD 

3.77 

2.87 

2.63 

1.41 

3.05 

n 

4 

4 

4 

2 

14 

X 

0.50 

8.00 

5.00 

1.00 

6 . 60 

SD 

6 . 36 

0.0 

0.0 

0.0 

4.83 

n 

*> 

1 

1 

1 

5 

X 

4.75 

5 . 56 

5.71 

5.75 

5 .54 

3 

SD 

4.  11 

3.05 

3.50 

3 . 62 

3.29 

n 

4 

9 

7 

8 

28 

X 

7.80 

7.00 

3.00 

4.40 

5.79 

4 

SD 

6.61 

4.24 

1.41 

3.21 

4.68 

n 

5 

2 

2 

5 

14 

Column 

X 

7.07 

5.81 

6.14 

5 . 44 

6.  10 

Totals 

SD 

4.96 

2.90 

3.35 

3.52 

3.71 

n 

15 

16 

14 

16 

61 

35 
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TABLE  6 

FILM  10  RETENTION'  TEST  MEANS  AND  STANDARD  DEVIATIONS 
FOR  APTITUDE  PROFILE  X  INSTRUCTIONAL  STRATEGY  CELL  (N  =  61) 


Aptitude 

Profile 

Groups 

I  ns  t  rue t ionj  1 

Strategy  Groups 

Row  Totals 

i 

2 

3 

-4 

X 

7.25 

7 .50 

7.50 

9 . 00 

7 . 64 

1 

SD 

3.20 

2.89 

2.89 

0.0 

2.56 

n 

4 

4 

4 

2 

14 

X 

9.00 

9.00 

9.00 

5.00 

8.20 

2 

SD 

0.0 

0.0 

'  0.0 

0.0 

1  .  79 

n 

•> 

i 

] 

1 

5 

X 

4.50 

7.22 

7.14 

4.00 

5.89 

3 

SD 

4.  12 

3.42 

3.13 

3.82 

3.70 

n 

4 

9 

7 

8 

28 

X 

7.20 

7.00 

7.00 

6.00 

6.71 

4 

SD 

2.77 

4.24 

4.24 

4.0b 

3.24 

n 

5 

0 

2 

- 

14 

Column 

X 

6.73 

7.38 

7.36 

5.31 

b .  67 

Totals 

SD 

3.22 

3.05 

2.84 

3.75 

3.28 

n 

15 

16 

14 

16 

61 

t 
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TABLE  7 


FILM  12  PERFORMANCE  TEST  MEANS  AN  STANDARD  DEVIATIONS 
FOR  APTITUDE  PROFILE  X  INSTRUCTIONAL  STRATEGY  CELL  (N  =  S' 


Apt itude 
Pro  f i 1 e 
Groups 

Ins  t  ruct  i  ona  1 

1  2 

Strategy  Group 

5 

s 

*4 

Rou  Tit  1 1  s 

X 

7.00 

10.80 

16.40 

7.50 

13.19 

1 

SD 

3.56 

3.96 

b.  19 

3.54 

5.78 

n 

4 

5 

5 

> 

lb 

X 

17.25 

12.00 

16.00 

12.33 

15.00 

2 

SD 

13.28 

2.83 

9.77 

7.64 

9.20 

n 

-4 

) 

3 

1  *4 

X 

5.80 

9  .  -4b 

11.5b 

9.00 

9  .  3d 

3 

SD 

6.37 

5.65 

'  .97 

A.  18 

b  .  12 

n 

5 

13 

9 

9 

36 

X 

15.13 

9.75 

11.10 

12.50 

12.76 

4 

SD 

11.17 

0.50 

o .  08 

4.18 

'  .  50 

n 

8 

*4 

3 

O 

-1 

Column 

X 

11.76 

10.00 

13.59 

10.40 

11.43 

Totals 

SD 

10.23 

4.52 

7.69 

4. 75 

7  .  16 

n 

21 

24 

22 

20 

87 

37 
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TABLE  8 

FILM  12  PERFORMANCE  TEST  MEANS  AND  STANDARD  DEVIATIONS 
FOR  APTITUDE  PROFILE  X  INSTRUCTIONAL  STRATEGY  CELL  (N  =  61) 


Apt  i  t  tide 

H  ro !  i  1  e 

Instructiona  1 

Strategy 

Groups 

Row  Total 

Groups 

1  2 

3 

4 

X 

7.00 

11.00 

17.00 

7.50 

11.07 

SD 

3 . 3b 

A. 55 

6  98 

3.54 

0.  15 

n 

u 

A 

u 

14 

X 

i : .  oc 

1-.00 

29.00 

19.00 

16.80 

SD 

2  .  S3 

I.o 

0.0 

0.0 

7  .  o9 

n 

1 

’ 

1 

5 

X 

3.50 

3.2_ 

9 . 29 

S  .  03 

7.93 

SD 

-.73 

5.07 

5.25 

-.31 

5  .  15 

n 

*4 

9 

/ 

S 

28 

- 

12  .  AO 

o 

o 

9 . 50 

12.00 

11.50 

-♦ 

SD 

12  .  18 

0.0 

7  .  78 

«4  .  *4  7 

7 . 60 

N 

3 

> 

s 

1A 

Co  l  uir.n 

X 

8.-0 

9 . 50 

12.93 

10.  w 

10 . 20 

Totals 

SD 

8.03 

-.93 

7  91 

*♦  •  3  > 

0.57 

n 

15 

lb 

1- 

1  0 

OI 
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TABLE  9 


FILM  12  RETENTION  PERFORMANCE  TEST  MEANS  AND  STANDARD  DEVIATIONS 
FOR  APTITUDE  PROFILE  X  INSTRUCTIONAL  STRATEGY  CELL  (N  =  61) 


Aptitude 
Prof i le 
Groups 


Instructional  Strategy  Groups 


1 


3 


Rc-.v  Total 


X 

8.00 

11.00 

13.25 

7.50 

10.29 

1 

SD 

2.45 

4.55 

7.85 

3.54 

5.20 

n 

4 

4 

4 

o 

14 

X 

8.50 

10.00 

5.00 

10.00 

8.40 

2 

SD 

2.  12 

0.0 

0.0 

0.0 

2.30 

n 

•-> 

1 

1 

1 

5 

X 

11.00 

1 0 . 44 

14.14 

10. b3 

11.50 

3 

SD 

2.  16 

4 . 56 

6.04 

6 . 46 

5 . 30 

N 

4 

9 

7 

8 

28 

X 

11.40 

9.50 

8.50 

9.40 

10.00 

4 

SD 

7 . 96 

0.71 

2.  12 

2.61 

4.82 

n 

5 

2 

- 

5 

14 

Column 

X 

10.00 

10.44 

12.43 

9.81 

10.62 

Totals 

SD 

4.  SI 

3.93 

6.31 

4.82 

4.97 

n 

15 

16 

U 

1 6 

61 

TABLE  10 


RANGE  RING  PROFILE  WRITTEN  TEST  MEANS  AN 0  STANDARD  DEVIATIONS  FOR 
APTITUDE  PROFILE  X  INSTRUCTIONAL  STRATEGY  CELL  (N  =  87) 


Aptitude 

Pro  f i Le 

I  ns  true t  Lona 1 

Strategy  Groups 

Rov.  Totals 

1  2 

3  4 

Groups 

X 

3b.  25 

39.20 

38.60 

44 . 00 

38.88 

1 

SD 

11.21 

3 . 70 

4.93 

4.24 

6.47 

n 

4 

5 

5 

2 

16 

X 

36.75 

38.00 

38.  SO 

42 . 00 

38.79 

2 

SD 

2.87 

4.24 

3.78 

5.2b 

3.95 

n 

4 

2 

5 

3 

14 

X 

20.80 

35.92 

30 .  "t4 

30.89 

32  ■  44 

3 

SD 

5.50 

6 . 26 

5.59 

b  .  58 

6.41 

n 

5 

13 

9 

9 

36 

X 

30.38 

37.25 

37.00 

32. b7 

33.29 

4 

SD 

5 . 80 

6.40 

2 . 65 

4.80 

5.75 

n 

8 

4 

3 

6 

i 

—  l 

Column 

X 

32.57 

37.00 

35.09 

34 . 40 

34.85 

Totals 

SD 

6.93 

5 . 55 

5.98 

7 . 34 

b  .  5  3 

n 

21 

24 

2  2 

20 

87 

TABLE  II 


RANGE  RING  PROFILE  WRITTEN  TEST  MEANS  AND  STANDARD  DEVIATIONS  FOR 
APTITUDE  PROFILE  X  INSTRUCTIONAL  STRATEGY  CELL  (N  =  61) 


Aptitude 

Profile 

Groups 


Instructional  Strategy  Groups 
1  2  3 


Row  Total s 


X 

36.25 

40.25 

39.00 

44 . 00 

39.29 

1 

SD 

11.21 

3.30 

5.60 

4 . 24 

6.83 

n 

4 

4 

4 

2 

14 

X 

37.50 

35.00 

41.00 

48 . 00 

39.80 

2 

SD 

2.  12 

0.0 

0.0 

0 . 0 

5.  17 

n 

2 

1 

1 

1 

5 

X 

30.75 

3  6  .  t>  7 

32 . 29 

31 .25 

33.  18 

3 

SD 

5.85 

2.35 

4.57 

b  . 

5.37 

n 

4 

9 

7 

8 

28 

X 

33.00 

42.00 

36.00 

34. 20 

35.14 

4 

SD 

4.53 

2.83 

2.83 

3.35 

4.52 

n 

5 

0 

5 

14 

Column 

X 

33.87 

38.13 

35 . 3b 

34.81 

35.57 

Totals 

SD 

6.85 

3.28 

3 . 40 

'.51 

6 . 0b 

n 

15 

lo 

14 

16 

6 1 

TABLE  12 

RANGE  RING  PROFILE  WRITTEN  RETENTION  TEST  MEANS  .AND  STANDARD 
DEVIATIONS  FOR  APTITUDE  PROFILE  X  INSTRUCTIONAL  STRATEGY  CELL  (N  =  61) 


Instructional  Strategy  Groups 


Apt  itude 
Prof  i  Le 
Groups 


1 


3 


Row  Totals 


$ 


TABLE  13 

SIMMAKY  i'F  THE  MULTIPLE  REGRESSION  ANALYSES  FOR  FILM  10 


Depend . 
Neas  . 

u  r  tub  1  e 

Prop,  of 

Va  r  unce 
iR  s < j .  change 

)  SS 

df 

Mean 

S-ii.a  re 

F 

n 

Pro tile  x 
Strategy 

. 12357 

150.289 

9 

lo.988 

1.202 

ns 

Film  10 

Prof i le 

.02662 

32.376 

3 

10.792 

<  1 

ns 

(N=87 ) 

Strategy 

.03876 

47.141 

3 

15.714 

1.131 

ns 

Residua  1 

.81105 

986.430 

71 

13.893 

Total 

1.00000 

1,216.236 

So 

Profile  x 
Strategy 

.  10174 

83.970 

9 

9.330 

<  1 

ns 

Film  10 

Profile 

.06429 

53.066 

3 

17.887 

1.212 

ns 

(N=6 1 ) 

Strategy 

.03843 

31.722 

3 

10.574 

<  1 

ns 

Residua  1 

.79554 

656 .  c>5 1 

45 

14.922 

Total 

1.00000 

825.409 

bO 

Profile  x 
Strategy 

.08691 

56.095 

9 

6.233 

<  1 

ns 

Film  10R 

Prof i le 

.08382 

54. 100 

3 

18.033 

1 .564 

ns 

( N=6 1 ) 

Strategy 

.02523 

16.285 

3 

5.283 

<  1 

ns 

Res idua  1 

.80404 

518.963 

45 

11.533 

Tota  1 

1.00000 

645 . 443 

60 

t 


44 


TABLE  14 


SUMMARY  OF  THE  MULTIPLE  REGRESSION  ANALYSES  FOR  FILM  12 


Depend.  Prop,  of 


Meas . 

Variance 

Mean 

Variable 

(R  sq.  change)  SS 

df 

Squa  re 

F 

2 

Profile  x 
Strategy 

.08773  386.824 

9 

42.980 

Film  12 

Prof i le 

.07957  350.845 

3 

116.948 

(N=87 ) 

Strategy 

.02956  130.338 

3 

43 . 446 

Residual 

.30314  3,541.256 

71 

49.763 

Tota  1 

1.00000 

4 , 409 . 26 4 

86 

Profile  x 
Strategy 

•  10435 

270.438 

9 

30.487 

<-  1 

ns 

Film  12 

Profile 

. 14982 

388.279 

3 

129.426 

3.595 

.025 

(N=6 1 ) 

Strategy 

. 12072 

312.863 

3 

104.288 

2.897 

.05 

Residual 

.62511 

1,620.059 

45 

36.001 

Total 

1.00000 

2,591.639 

60 

Profile  x 
Strategy 

. 10348 

153.598 

9 

17.066 

<  1 

ns 

Film  12R 

Profile 

.04585 

68.056 

3 

22.685 

<  1 

ns 

( N=6  1 ) 

Strategy 

.00308 

4.572 

3 

1.524 

<  1 

ns 

Residual 

.84759 

1,258.104 

45 

27.956 

Total 


1.00000  1,484.104  60 


Post  hoc  comparisons  were  performed  using  Fisher's 
Least  Significant  Difference  (LSD)  Procedure,  adjusting  for 
the  compounding  of  the  comparisonwise  error  rate  (Kirk, 
1968).  According  to  the  adjustment,  only  comparisons  that 
had  a  t  probability  of  .01  or  less  would  be  considered 
significant  at  the  .05  level.  Any  contrasts  with  a  t 
probability  greater  than  .01  but  less  than  or  equal  to  .05 
could  be  said  to  approach  significance.  See  Table  15  for  a 
summary  of  these  comparisons  following  significant  main 
effects  for  Film  L2. 

The  results  of  the  multiple  regression  analyses  of 
aptitude  profile,  instructional  strategy,  and  interactions 
for  the  immediate  and  retention  Range  Ring  Profile  written 
posttests  are  summarized  in  Table  16.  There  were  no 
significant  interaction  or  strategy  effects  on  the  RRP 
written  tests.  However,  there  were  significant  main  effects 
for  aptitude  profile  at  the  .05  level  in  all  three  analyses. 
Because  of  the  significant  main  effects  for  profile,  further 
analyses  were  conducted,  again  using  the  adjusted  LSD 
method.  Table  17  presents  a  summary  of  the  post  hoc 
comparisons  following  significant  aptitude  profile  effects 
on  all  RR?  written  tests. 

Results.  The  analysis  of  the  results  of  the 
confirmatory  phase  of  the  REDEYE  study  can  be  summarized  in 
the  following  manner: 

1.  There  were  no  significant  interactions  between 
aptitude  profile  groups  and  instructional  strategy 
groups  on  either  the  immediate  or  retention  tests 
for  Film  10,  one  of  the  two  performance  tests.  In 
addition,  there  were  no  significant  main  effects 
for  either  profile  or  strategy  on  either  of  the 
measures.  These  results  were  observed  for  either 
the  full  sample  population  of  87  men  or  for  the  61 
who  completed  both  immediate  and  retention  testing. 

2.  There  were  no  significant  interactions  between 
aptitude  profile  groups  and  strategy  groups  on  the 
other  performance  test — Film  12--for  either  the 
immediate  or  retention  posttests.  Again,  this  was 
the  case  for  either  size  sample. 

3.  There  was  a  significant  difference  (.025)  between 
Film  12  immediate  performance  posttest  scores  of 
the  aptitude  profile  groups  for  the  sample  of  61 
subjects  only.  Further  analyses  indicated  that  men 
with  Profile  2  performed  significantly  better  than 
those  with  Profile  3.  Those  with  Profile  2  also 
performed  better  than  subjects  with  Profiles  1  or  4 
but  the  differences  in  these  cases  only  approached 
significance . 
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TABLE  15 


POST  HOC  LSD3  COMPARISONS  BETWEEN  MEANS  FOLLOWING 


SIGNIFICANT  MAIN 

EFFECTS  ON 

FILM  12 

(N  =61) 

Dependent 

Variable 

t  probab 

i  1  it  los 

F  Llni  la 

Prof l le 

3 

P  ro  f  l  i  e 

1 

Profile  Profile 

A  2 

Count 

Mean 

28 

7.9286 

Profile  3 

14 

11.0714 

Profile  1 

.  125 

14 

11.5000 

Profile  4 

.  102 

.887 

5 

16.8000 

Profile  2 

.001* 

.024 

.034 

6 1 

10.1967 

Total 

% 


Film 

12 

t  probabilities 

Strategy 

1 

Strategy 

2 

Strategy 

4 

Strategy 

3 

Count 

Mean 

15 

8.4000 

Strategy 

1 

16 

9.5000 

Strategy 

2 

.378 

16 

10.1875 

Strategy 

4 

.212 

.  736 

14 

12.9286 

Strategy 

3 

.  005* 

.070 

.  134 

6 1 

10.1967 

Tota  1 

aFisher’s  Least  Significant  Difference  Test  adjusted  for  the 
compounding  of  the  comparison-wise  error  rate.  Since  alpha  was  set  at 
.05  for  the  entire  experiment,  any  t  probability  that  is  .01  or  less 
would  indicate  significance  at  the  .05  level. 

*p  <  .05 


t 
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TABLE  16 


% 


t 


SUMMARY  OF  THE  MULTIPLE  REGRESSION  ANALYSES 
FOR  THE  RANGE  RING  PROFILE  WRITTEN  TEST 


Ot-' pend  . 

Me  as  . 

Variable 

Prop,  of 

Variance 

(R  sq.  change)  SS 

df 

He. in 
Square 

F 

r> 

Profile  x 
Strategy 

.09816  359.958 

9 

39.995 

1 . 195 

ns 

RRP 

Profile 

.19634  719.990 

3 

239.997 

7  . 168 

.001 

f  N=87 ) 

Strategy 

.05726  209.976 

3 

69 . 992 

2.091 

ns 

Residua  1 

.64824  2,377.133 

71 

33.481 

Tota  1 

1.00000 

3,667.057 

86 

Profile  x 
Strategy 

. 14269 

314.334 

9 

34.926 

1 . 229 

ns 

RRP 

Profile 

.20449 

450.475 

3 

150.158 

5.285 

.005 

IN=61) 

Strategy 

.07246 

159.623 

3 

53.208 

1.873 

ns 

Res idua  1 

.58036 

1 ,278.-479 

45 

28.411 

Total 

1.00000 

2,202.910 

60 

Profile  x 
Strategy 

.11062 

223.115 

9 

24.791 

<  1 

ns 

RRPR 

Profile 

.25233 

508.937 

3 

169 . 646 

6.398 

.005 

(N=61) 

Strategy 

.04549 

91.751 

3 

30.584 

1 .  153 

ns 

Residual 

.59156 

1,193.151 

45 

26.514 

Tota  1 

1.00000 

2,016.954 

60 
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TABLE  17 


POST  HOC  LSD3  COMPARISONS  BETWEEN  MEANS  FOLLOWING 
SIGNIFICANT  RRP  APTITUDE  PROFILE  EFFECTS 


Range  Ring 
Profile  Test 
(N  =  87) 

t  probabilities 

Profile 

3 

Profile 

4 

r rot  ue 

2 

Pro  file 

1 

Count 

Mean 

36 

32.4444 

Profile 

3 

21 

33.2857 

Profile 

4 

.  136 

14 

38.7857 

Profile 

2 

.  ooi- 

.035 

16 

38.8750 

Profile 

1 

.001'- 

.014 

.783 

87 

34 . 8506 

Total 

Range 

Ring 

Profile 

Profile 

Pro f  ile 

Profile 

Profile  Test 

3 

4 

1 

*> 

<4. 

(N  =  61) 


Count 

Mean 

28 

33.1786 

Profile  3 

14 

35.1429 

Profile  4 

.067 

1 4 

39.2857 

Profile  1 

<  .001* 

.  106 

5 

39.8000 

Profile  2 

.007* 

.174 

.864 

61 

35.5738 

Total 

Range  Ring  Profile 
Retention  Test 
(N  =  61) 

Profile 

3 

Prof i le 

4 

Prof i le 

•> 

Prof i le 

1 

Count 

Mean 

28 

33.8214 

Profile  3 

14 

37.7857 

Profile  4 

.018 

5 

39.2000 

Profile  2 

.019 

.519 

14 

41.2143 

Profile  1 

<  .001* 

)  .146 

.  o58 

61 

36.8689 

Total 

aFisher's  Least  Significant  Difference  Test  adjusted  for  the 
compounding  of  the  comparison-wise  error  rate. 

\  <  .05 


f  t, 


4. 


There  was  a  significant  difference  (.05)  between 
the  Film  12  immediate  performance  posttest  scores 
of  the  different  strategy  groups  for  the  sample  of 
61,  but  not  for  that  with  87.  Further  analyses 
revealed  that  those  who  received  Strategy  3 
performed  signif icantly  better  than  men  who 
received  Strategy  1 . 

5.  There  were  no  significant  interaction  or  main 
effects  for  instructional  strategy  or  aptitude 
profile  in  either  sample  on  the  Film  12  performance 
retention  test. 

6.  No  significant  interactions  between  aptitude 
profile  and  instructional  strategy  group  were 
observed  on  either  the  immediate  or  retention 
written  tests  (Range  Ring  Profile  Tests)  for  either 
sample  size.  Nor  were  there  any  significant 
strategy  effects  on  either  test. 

7.  Significant  main  effects  for  aptitude  profile  were 
observed  for  both  samples  on  the  immediate  written 
tests  and  on  the  retention  written  test  (.05).  For 
N  =  87,  further  analyses  revealed  that  both 
Profiles  1  and  2  performed  significantly  better 
than  Profile  3.  The  same  two  profiles'  posttest 
scores  were  better  than  the  Profile  4  test  scores, 
but  the  differences  in  these  instances  only 
approached  significance.  For  N  =  61,  analyses 
indicated  that  for  either  test.  Profile  Group  1 
performed  significantly  better  than  Profile  Group 
3.  On  the  immediate  posttest,  the  performance  of 
Profile  2  was  also  significantly  better  than  that 
of  Profile  3.  On  the  retention  test  Profile  2  and 
4  approached  being  significantly  better  than 
Profile  3. 

8.  The  immediate  test  and  retention  test  performance 
data  were  not  compared  statistically  for  any  of  the 
three  dependent  measures.  Averaged  over  the  main 
effects,  the  retention  test  mean  scores  were  higher 
than  the  immediate  scores  on  film  10  (6.67  vs 
6.10),  on  Film  12  (10.62  vs  10.20)  and  on  the  RRP 
written  test  (36.87  vs  35.57).  In  general,  within 
aptitude  profile  and  instructional  strategy  for  the 
dependent  measures  there  was  a  tendency  for  mean 
posttest  scores  to  regress  toward  the  grand  mean, 
i.e.,  the  larger  immediate  mean  test  scores  showed 
a  decrease  on  retention  test  and  the  smaller 
immediate  test  scores  showed  an  increase  on 
retention  test.  The  aptitude  profile  and  strategy 
effects  on  Film  12  suggest  a  possible  differential 
effect  of  aptitude  and  strategy  on  acquisition  as 
compared  with  retention.  For  the  Film  12  immediate 
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test  data,  the  Aptitude  Profile  2  mean  was  greater 
than  the  Aptitude  Profile  3  mean  and  the  Strategy  3 
mean  was  greater  than  the  Strategy  1  mean. 

However,  for  the  retention  data,  neither  aptitude 
profile  nor  strategy  effects  were  significant.  The 
largest  improvement  in  mean  score  from  the  Film  12 
immediate  test  to  the  retention  test  occurred  for 
Aptitude  Profile  3  (7.93  to  11. ‘SO  (N=28)). 

Discussion.  Based  on  the  analysis  of  the  data,  the 
results  have  been  summarized  and  several  conclusions  have 
been  drawn.  However,  it  must  be  pointed  out  that  the 
interpretation  of  the  data  was  made  complex  by  the  fact  that 
there  was  not  complete  random  assignment  (i.e.,  to  a  fully 
crossed  design) .  While  random  assignment  to  strategy  group 
was  achieved,  it  cannot  completely  substitute  for  the 
increased  control  and  power  that  would  have  been  present  had 
there  been  random  assignment  from  aptitude  profile  groups  -o 
strategy  groups.  A  careful  inspection  of  the  ceil  sizes 
(Tables  4  -  12)  will  reveal  the  effect  that  this  lack  of 
randomization  had  on  the  distribution  of  cases  in  the  study. 
The  most  serious  imbalance  occurred  with  Aptitude  Profile  2 
subjects,  especially  for  the  retention  data.  For  retention, 
some  cell  sizes  for  Profile  2  have  only  one  case,  which  is 
totally  unacceptable  if  one  wants  to  have  confidence  to 
generalize.  Nevertheless,  this  occurred  and  the  results  and 
conclusions  must  be  looked  at  in  light  of  these  conditions. 

Another  occurrence  that  may  limit  the  generalizability 
of  any  conclusions  from  the  confirmatory  analysis  is  now 
presented.  Possible  implications  of  this  occurrence  must  be 
considered  when  interpretations  of  the  data  are  made. 

The  number  of  soldiers  who  qualified  for  Profile  2  was 
much  smaller  than  anticipated.  In  the  earlier  research 
Hebein,  1978;  Sullivan  et  al.,  1978),  the  only  group  for 
whom  there  were  few  cases  was  Profile  1.  There  had  been  no 
shortage  of  Profile  2  people  and  there  was  no  reason  to 
suspect  that  a  shortage  in  this  group  would  occur  in  this 
study.  Related  to  the  number  of  people  who  qualified  for 
Profile  Group  2,  was  the  actual  make-up  of  their  aptitude 
pattern.  Eight  of  the  fifteen  soldiers  who  were  analyzed  in 
the  Profile  2  group  also  qualified  for  membership  in  Group 
1.  This  left  only  seven  people  with  Profile  2  whose 
aptitude  profile  was  uncontaminated  by  that  of  any  other 
profile.  Recall  that  there  were  four  people  with  Profile  3 
that  also  had  Profile  2.  This  means  that  of  all  the  people 
who  qualified  for  Profile  2,  more  of  them  had  duplicate 
qualifications  with  another  profile  than  had  Profile  2 
alone.  This  did  not  happen  in  the  earlier  contract  research 
and  further  complicates  the  interpretation  of  conclusions 
about  Profile  2. 


51 


Exploratory  Analysis 

Analysis .  For  the  sake  of  economy,  all  exploratory 
analyses  were  performed  on  the  subset  of  61  cases,  for  whom 
there  was  complete  training  and  retention  data.  If  there 
were  differences  between  the  full  sample  of  87  and  the  61, 
these  differences  were  not  explored.  The  advantage  of  jsir.c 
the  61  case  sample  was  that  complete  data  on  all  cases  were 
available.  A  sample  size  of  only  61  is  not  ’.arc*  enc  :csh  t  : 
allow  strong  inferences  to  be  made  concerning  the  issues 
investigated.  Nevertheless,  a  look  at  the  data  may  provr 3e 
insights  that  .will  both  help  to  explain  any  underlying 
structure  to  the  data  and  that  will  point  towari  rrcm.isir.c 
hypotheses  for  future  studies . 

Results  of  the  exploratory  analyses  are  speculative  and 
should  be  viewed  with  caution.  The  later  discussion  (in 
Chapter  IV)  of  similar  analyses  on  CHAPARRAL  and  VULCAN 
samples  should  be  considered  as  a  partial  replication  of  the 
exploratory  REDEYE  analyses  even  though  there  was  not  an 
experimental  study  for  any  of  the  CHAPARRAL /VULCAN  (C,V) 
groups.  The  results  of  the  three  similar  exploratory 
analyses  for  the  three  sample  populations  may  provide 
stronger  support  for  inferences  concerning  performance 
according  to  aptitude  patterns  than  would  the  REDEYE 
analysis  alone.  If  this  proves  to  be  the  case,  a  clear 
direction  for  research  in  this  area  may  be  revealed. 

The  tests  for  the  entire  aptitude  battery  (including 
those  used  for  aptitude  profile  formation  and  those  used  for 
exploratory  purposes)  were  scored  for  all  soldiers.  3oth 
immediate  and  retention  performance  and  written  tests  were 
also  scored.  Shown  on  Table  18  is  a  summary  of  the  variable 
names  and  labels  used  for  the  REDEYE  sample.  A  summary  of 
the  means,  standard  deviations,  and  number  of  cases  on  which 
each  measure  was  based  is  presented  in  Table  19. 

A  series  of  factor  analyses  were  performed  in  order  to 
investigate  the  underlying  structure  of  the  aptitude 
variables.  As  stated  already,  all  measures  except  the  Total 
Thurstone  were  submitted  to  the  factor  analyses.  The 
correlation  matrices  upon  which  the  factor  analyses  and 
subsequent  canonical  correlation  analyses  were  based  are 
presented  in  Appendix  D. 

The  first  factor  analysis  included  twenty-eight 
independent  variables  from  the  aptitude  test  battery  and  the 
number  of  factors  was  unrestricted.  A  summary  of  the 
eigenvalues,  percent  of  variance  explained,  and  cumulative 
percent  of  variance  for  both  significant  and  nonsignificant 
factors  is  presented  in  Table  20.  The  factor  matrix,  before 
rotation  by  the  varimax  method,  is  presented  in  Table  21. 

It  yielded  eight  factors  with  an  eigenvalue  greater  than 
one.  Also  in  Table  21  is  the  rotated  factor  matrix, 
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TABLE  18 


SUMMARY  OF  INDEPENDENT  AND  DEPENDENT  VARIABLES  COLLECTED 
FROM  REDEYE  GUNNERS  AT  TIME  OF  REFRESHER  TRAINING 


Variable 

Name 

Variable 

Label 

Extended 

Label 

VI 

Age 

V2 

Word 

From  the  Press  Test 

V3 

Color 

From  the  Press  Test 

V4 

Wintc 

From  the  Press  Test  (Color  naming 
with  distraction) 

(Note: 

V2-V4  purport  to  measure  the  ability 
to  work  under  stress.) 

V5 

Cl  flex 

Closure  Flexibility 

V6 

Cl  spd 

Closure  Speed 

V7 

LTH 

Language  Thurstone 

V8 

QTH 

Quantitative  Thurstone 

V9 

TTH 

Total  Thurstone 

V10 

GEFT 

Group  Embedded  Figures  Test 

VI 1 

Pursuit 

From  MacQuarrie  Test 

VI  2 

State 

State  Anxiety 

VI 3 

Trait 

Trait  Anxiety 

V14 

2dim 

Two  Dimensional  Spatial  Relations 

VI 5 

FA 

Reserved/ Outgoing 

V16 

FB 

Less  Intell/More  Intell 

V17 

FC 

Affected  by  f eelings/Emotional ly 
Stable 

V18 

FE 

Humble/ Assertive 

V19 

FF 

Sober /Happy-go- lucky 

V20 

FG 

Expedient/ Conscientious 

V21 

FH 

Shy/ Venturesome 

V22 

FI 

Tough-minded /Tender-minded 

V2  3 

FL 

Trus  ting/ Suspicious 

V24 

FM 

Practical /imaginative 

V2  5 

FN 

Forthright/ Astute 

V26 

FO 

Sel f-Assu red/ Apprehensive 

V2  7 

Q1 

Conservative /Experimenting 

V28 

Q2 

G roup- dependent/ Self-sufficient 

V29 

Q3 

Undisciplined  Self-conflict/ 
Controlled 

V30 

Q4 

Relaxed/Tense 

V33 

Film  10 

Film  10  (Fast,  Constant  Speed 

Targets ) 

V34 

Film  12 

Film  12  (Variable  Speed,  Mixed 
Target-Types ) 

V35 

MTS  ANX 

State  Anxiety  for  MTS  Performance 

V3  6 

RRP 

Range  Ring  Profile  Written  Test 

V37 

Film  10R 

Film  10  Retention 

V38 

Film  12R 

Film  12  Retention 

V39 

RRPR 

Range  Ring  Profile  Retention 
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TABLE  19 


SUMMARY  OF  MEANS  AND  STANDARD  DEVIATIONS 
FOR  REDEYE  INDEPENDENT  AND  DEPENDENT  VARIABLES 


VAMAdLTS.. 

LA.ITL  s.  . 

MEAN 

STANOAPO  Dtv 

CASES 

V  2 

W  0  9  '"> 

o9.13tl 

17.6233 

6  1 

V  3 

COLOR 

67. 32  79 

1 5.4366 

6  1 

V4 

•  INTO 

37. 72  13 

1 2 . 569  y 

6  1 

V5 

CLFLEx 

4  1  .  0*  84 

34 .22 4 1 

6  1 

V  6 

CLSPO 

9.2951 

5 .064  1 

6  1 

V7 

L  tM 

22. 7377 

1  1.3415 

6  1 

V  8 

QTh 

1  5 . 0(  56 

9.0477 

6  1 

VIO 

GEF  T 

7. 4590 

5 .6 1  1  2 

6  1 

V  1  1 

PUP  SUI  T 

1  d. 9t  72 

7.741o 

6  1 

VI  2 

STATE 

37.3934 

8.9633 

6  1 

V  1  3 

TRAIT 

3  8  •  Oo5t> 

8.8164 

6  1 

V  l  4 

20  I  M 

12.0*  5o 

6.0549 

6  1 

V  1  5 

FA 

6.6f 57 

2.535o 

6  1 

V  1  6 

f  a 

3 . 0393 

1 .7704 

e  l 

V  1  7 

re 

6.6  066 

2.2331 

6  1 

V  1  8 

F  E 

6.1311 

2.1329 

6  1 

v  i  9 

FF 

o  .  (  0  5  2 

2.4090 

.6  1 

V  2  0 

FG 

7.  6<-8S 

2.0211 

6  1 

V2  1 

FH 

7. OC  00 

2  .5820 

61 

V  2  2 

F  I 

5  .  1  c  3  9 

1 . 8365 

6  1 

V23 

FL 

7.1311 

1  .7746 

61 

V  2  4 

FM 

5. 4  754 

l  .7186 

6  1 

V  25 

fn 

5.5410 

2. 1492 

61 

V26 

FG 

5.2523 

2.5942 

61 

V27 

G  1 

7. 04  Q2 

2.0447 

61 

V28 

Q2 

4.9344 

2.2425 

6  1 

V?6 

Q3 

7.3770 

2 . 1  304 

6  1 

V30 

Q4 

4.8197 

2.1409 

6  1 

V33 

F  I  L  A  10 

6.0484 

3.7090 

ft  1 

V  3  4  > 

F  IL  1  l  «_ 

10. 1967 

6  .5722 

6  1 

V  35 

MTS  AN* 

37.  3770 

9.2793 

6  1 

V36 

RPP 

35.5738 

6 . 0543 

6  1 

V37 

FILM  1  OR 

6.6721 

3.2743 

6  1 

V38 

F  I  L  *4  1  2R 

1  0. 62  30 

4.9733 

6  1 

V39 

RRPR 

36 .8069 

5.7979 

61 

TA3LE  20 


SUMMARY  STATISTICS  FOR  ALL  FACTORS  IN 
UNROTATED  FACTOR  ANALYSIS  OF  61  REDEYE  CASES 


VALUE  USED 


VARIABLE 

IN  DIAGONAL 

FACTOR 

EIGENVALUE 

PCT  OF  VAR 

CUM  PIT 

V  2 

1.00000 

1 

6.37241 

22.8 

22.8 

73 

1.00000 

2 

3.29173 

11.8 

34.5 

V4 

1 .00000 

3 

2.29571 

8.2 

42.7 

V  5 

1.00000 

4 

2.01157 

7.2 

49.9 

V6 

1 .00000 

5 

1 .81316 

6.5 

56.4 

V7 

1.00000 

6 

1.61085 

5.8 

62.1 

V8 

1.00000 

7 

1 .32918 

4.  7 

66.9 

V10 

1 . 00000 

8 

1.16845 

4.2 

71 .0 

vn 

1 . 00000 

9 

0.96265 

3.4 

74.5 

VI  2 

1.00000 

10 

0.91889 

3.3 

77.8 

VI  3 

1.00000 

11 

0.80196 

2.9 

80.6 

VI 4 

1.00000 

12 

0. 74333 

2.  7 

83.3 

VI  5 

1 .00000 

13 

0.70103 

2.5 

85.8 

V 16 

1 . 00000 

14 

0.52222 

1.9 

87.7 

VI  7 

1.00000 

15 

0.50909 

1.8 

89.5 

V18 

1 .00000 

16 

0.45871 

1.6 

91  .1 

VI  9 

1 .00000 

1  7 

0.38855 

1.4 

92.5 

V20 

1 . 00000 

13 

0.36868 

1.3 

93.8 

V21 

1.00000 

19 

0.32960 

1.2 

95.0 

V22 

1.00000 

20 

0.26642 

i.O 

95.9 

V23 

1  .00000 

21 

0.24105 

0.9 

96.8 

V24 

1  .00000 

22 

0.22527 

0.8 

97.6 

V  25 

1 . 00000 

23 

0.17800 

0.6 

98.2 

V  26 

1.00000 

24 

0.16116 

0.6 

98.8 

V27 

1.00000 

25 

0.14118 

0.5 

99.3 

V28 

1.00000 

26 

0.07826 

0.3 

99.6 

V29 

1.00000 

27 

0.06996 

0.2 

99.9 

V30 

1 .00000 

28 

0.04087 

0.1 

100.0 

5 
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followed  by  the  transformation  matrix.  The  latter  indicates 
the  correlations  between  factors.  A  scree  analysis 
suggested  that  the  number  of  factors  should  be  restricted. 

Separate  factor  analyses  were  performed  restricting  the 
number  of  factors  to  four,  five,  and  seven.  Simple 
structure  analyses  were  performed  on  each  restricted  varimax 
rotated  factor  matrix.  These  analyses  revealed  that  the 
matrix  restricted  to  seven  factors  appeared  to  provide  the 
most  meaningful  solution.  The  seven  factor  solution  came 
closest  to  meeting  Thurstone's  five  rule  criteria  for  simple 
structure,  as  summarized  by  Kerlinger  (1973).  Both  the 
unrotated  and  the  rotated  matrices  for  the  seven  factor 
solution  are  presented  in  Table  22,  along  with  the 
transformation  matrix  for  the  factors . 

For  purposes  of  analysis,  positive  or  negative  loadings 
of  . 5  or  greater  were  considered  high  loadings,  those 
between  .2  and  .5  were  considered  substantial  loadings,  and 
those  less  than  .2  were  considered  as  zero  or  near  zero 
loadings.  The  rotated  factor  matrix  becomes  easier  to 
interpret  if  the  variables  that  load  on  each  factor  are 
listed  in  rank  order  according  to  magnitude.  Such  a  listing 
is  presented  in  Table  23.  In  order  to  save  space,  only  the 
loadings  of  +.3  or  greater  are  shown  on  the  table.  If  there 
were  other  loadings  between  .2  and  .3,  a  note  to  that  effect 
appears . 

For  clarity  purposes,  both  the  variable  name  (from  the 
computer  printout)  and  the  associated  label  is  presented  in 
Table  23.  Variables  that  have  two  names  separated  by  a 
slash  (e.g.  relaxed/tense )  list  the  descriptor  for  the  low 
score  on  the  measure  first,  followed  by  the  descriptor  for 
the  high  score.  If  there  is  any  difficulty  in  understanding 
a  variable  label,  refer  to  Table  18  for  an  extended  label. 
Tentative  names  for  the  first  six  factors  are  given.  A 
description  and  discussion  of  each  of  the  seven  factors 
follows . 

The  first  factor  is  best  called  "spatial-analytic." 

Some  would  argue  that  the  factor  is  primarily  a  general 
ability  factor.  However,  the  three  highest  loadings 
represent  tests  that  are  not  designed  as  strict  general 
ability  measures.  Rather,  the  GEFT  and  the  Closure 
Flexibility  test  measure  the  ability  to  disembed  simple 
forms  from  complex  forms.  This  is  alternately  called 
analytic  ability  or  field  independence.  The  problems  on 
these  tests  seem  to  require  that  learners  utilize  what  might 
be  called  spatial  skills.  The  two  dimensional  perception 
test,  which  is  the  only  variable  that  cleanly  loads  on  this 
factor  alone,  is  definitely  a  spatial  test.  Only  after 
these  more  spatial  tests,  do  the  more  formal  general  ability 
tests  show  up. 
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TABLE  22 


FACTOR  MATRICES 
FACTORS)  FOR 


(RESTRICTED  TO  SEVEN 
REDEYE  DATA  (N=61) 


F  AC  TOR  MATRIX  i/5  1 NG  WI1NC|F*L  FACTOR.  NQ  MIRATIONS 


factor  1 

FACTOR  2 

FACTOR  3 

factor  * 

FACTOR  5 

FACTOR  6 

FACTOR  7 

C0«6<UNAl.  ITT 

v  * 

0.71  78  3 

0.  0  0  533 

-0.36296 

0.*  1919 

0.07779 

0.0074 1 

0.02310 

0.62 030 

v  3 

0  •  TO  13  5 

0.06162 

-0  .4  3  06  6 

0.3599* 

0.2  71  33 

0.07359 

0.0*933 

0.9101 3 

V  A 

0.70676 

-0.06*92 

-0.27*72 

0.35676 

0.1  9297 

0.09731 

0  .0502 * 

0.  7399  0 

V) 

0 . 7A  42  0 

0.  19*42 

0.3  3  30  4 

-0.09V90 

-0 .02220 

0.007*2 

-0.24*51 

0.77*2  * 

0 .5992  9 

0.26391 

0.3  161  7 

0.27*90 

-0.2*667 

— O  .0*3** 

0.1 133* 

0.66*06 

V  7 

0  .6AS90 

-0.07530 

0.0*91  a 

-O. 1093 1 

0.0*661 

-0.03652 

0.1*602 

0.76  7  7  * 

0 .6300  7 

0.03676 

0.0.3©*  9 

-O.  1  0  36  C 

0.19126 

0 .0*5  7* 

0. 16979 

0.  T703  * 

V  JO 

0 .79  996 

0.  1  6366 

0  .2  971  * 

-0.2  739  3 

-0.0 1910 

-9. 0*009 

- 0  •  10973 

0.6*94  5 

V  |  1 

0  .66  21  1 

0.25  006 

0.0*27  9 

0.29326 

0.2  7*4* 

-0.13137 

0 .05  72  7 

0.  71  39  7 

V  1  ? 

0  •  02  23  9 

0.52  170 

0  •  1  V  57  3 

0.3*29* 

-0.27135 

0 • 32  32  t 

•O  .16  51  1 

0.6*09  5 

,13 

-O  .36  17  3 

0.72795 

0.0  1  31  6 

0.0*1 7* 

-0.06669 

-O  .02 127 

0.07701 

0.6667  0 

V  |  A 

0  .*651  1 

0.2259  1 

0.2*669 

-0. 09090 

-0.33230 

-0.02337 

-0.26639 

0.3363  3 

V  1 5 

-0  .*0699 

-0.  36  305 

0.1  9*4  7 

0.33206 

0  •  3  3o  75 

0.29736 

0.1 3*06 

0.6662  1 

V  )6 

0  .6*01  2 

-0.1  1  601 
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There  is  a  general  ability  character  to  this  first 
factor,  but  it  is  secondary  to  the  "spatial-analytic" 
dimension  already  discussed.  What  general  ability  is 
present  in  this  factor  is  manifested  in  a  complex  way  that 
seems  to  include  at  least  three  major  areas  of  intelligence 
(language,  mathematical,  and  spatial).  The  spatial  aspects 
are  clearly  the  most  important  in  this  factor. 

With  respect  to  general  ability  measures,  both  sections 
of  the  Thurstone  Test  of  Mental  Alertness  and  Factor  B  of 
the  16PF  (Less  Intelligent/More  Intelligent)  have  their 
highest  loadings  on  the  spatial-analytic  faccor.  These 
loadings  are  pQsitive.  But,  it  is  interesting  to  note  that 
these  three  primary  general  ability  measures  have 
substantial  loadings  (between  .2  and  .5)  on  two  and 
sometimes  three  other  factors  in  the  terminal  solution.  At 
the  same  time,  Closure  Flexibility  and  the  GEFT  have 
substantial  loadings  on  only  one  other  factor  other  than 
Factor  1.  This  suggests  that  the  GEFT  and  Closure 
Flexibility  appear  to  measure  the  same  thing  and  that  this 
something  is  more  independent  of  other  factors  than  are 
traditional  measures  of  general  ability  themselves. 
Personality  factors  with  high  positive  loadings  on  the 
spatial-analytic  factor  include  "reserved,"  "forthright," 
and  "suspicious,"  to  go  along  with  high  intelligence. 

The  second  factor  is  clearly  a  stress  related  factor 
which  might  be  called  the  "ability  to  work  under  stress."- 
This  factor,  with  three  variables  cleanly  loading  on  it  and 
only  it,  can  be  more  clearly  defined  than  was  Factor  1.  V2 
to  V4  (from  the  Press  Test)  were  all  designed  to  measure  the 
ability  to  work  under  stress.  They  required  performance 
under  the  pressure  of  an  extremely  short  time  limit.  They 
have  the  highest  positive  loadings  on  this  factor  and  have 
zero  or  near  zero  loadings  on  every  other  factor.  These 
three  measures  can  be  said  to  be  factorially  "pure."  At 
first  glance,  it  appears  that  general  ability  confounds  the 
factor,  since  the  positive  loadings  for  both  language  and 
quantitative  intelligence  measures  (V7  and  V8 )  are  almost  as 
high  in  Factor  2  as  they  are  in  the  "spatial-analytic" 
factor.  An  alternative  explanation  to  this  interpretation 
suggests  something  quite  different.  The  nature  of  the 
Thurstone  Test  of  Mental  Alertness,  from  which  V7  and  V8 
came,  has  a  time-pressure  character  to  it.  While  the  test 
does  measure  intelligence,  the  short  time  limit  and  the 
continually  alternating  question  types  adds  a  stressful 
aspect  to  the  test.  This  aspect  may  be  quite  independent  of 
the  abilities  it  would  take  to  correctly  answer  the 
questions  if  such  pressure  were  not  part  of  the  testing 
situation.  Therefore,  it  is  quite  reasonable  to  suggest 
that  the  high  positive  loadings  of  the  Thurstone  test  mean 
general  ability  on  the  "spatial-analytic"  factor  but  ability 
to  work  under  stress  on  this  factor.  In  other  words,  it 
could  be  that  different  aspects  of  the  same  test  are  being 
separated  out  into  the  two  factors. 
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The  Pursuit  Test  (Vll)  had  the  second  highest  loading 
on  Factor  2.  It  shares  the  time  pressure  aspect  of  the 
measures  already  named  for  this  factor  and  also  shares  some 
relationship  with  Factor  1.  However,  the  same  argument  as 
for  V7  and  V8  could  be  made  for  Vll  with  respect  to  general 
ability  and  the  ability  to  work  under  stress.  Other 
variables  which  load  on  the  factor,  that  have  a  time 
pressure  character  to  them,  are  closure  flexibility,  closure 
speed,  and  the  GEFT.  The  argument  advanced  for  V7,  V8  and 
Vll  could  apply  to  these  measures  as  well. 

Trait  anxiety  has  a  fairly  high  negative  loading  on 
this  Factor  2  and  suggests  that  low  anxiety  goes  hand  in 
hand  with  the  ability  to  work  under  stress.  This  makes 
intuitive  sense.  The  only  other  measure  with  an  appreciable 
loading  on  this  factor  is  V24  which  suggests  that 
imaginative  people  have  the  ability  to  work  under  stress. 
This  too  makes  intuitive  sense.  All  in  all.  Factor  2  as  the 
"ability  to  work  under  stress"  is  a  fairly  "neat  and  clean" 
factor . 

The  third  factor  is  almost  as  clearly  defined  as  Factor 
2.  This  third  factor  could  be  called  "anxiety".  The  four 
highest  loadings  on  this  factor  are  all  intertwined  with 
anxiety.  V30  has  the  highest  loading  on  this  factor  and  is 
factorially  "pure"  because  it  loads  on  no  other  factor.  The 
positive  loading  suggests  high  anxiety  because  of  its 
descriptor  "tense."  A  high  score  on  this  measure  was  one  of 
the  original  criteria  in  Sullivan  et  al.  (1978)  to  denote 
high  anxiety.  It  was  used  again  in  this  series  of  studies. 

The  "apprehensive"  dimension  of  V26,  high  trait  anxiety 
(V13),  and  the  "affected  by  feelings"  dimension  of  Vj.7  all 
have  very  high  loadings  on  this  factor  and  support  the 
definition  of  the  factor  as  "anxiety".  State  anxiety  and 
the  "shy"  dimension  of  V21  also  have  reasonably  high 
loadings  on  this  factor  and  make  sense  for  the  factor. 

There  is  also  a  fairly  high  negative  loading  for 
intelligence  (V16  from  the  16PF)  which  is  not  as  easily 
explained . 

The  loading  on  V16,  as  well  as  the  loadings  on  V6 
(Closure  Speed)  and  Vll  (Pursuit)  suggest  a  possible  but 
inconsistent  relationship  with  Factor  1  (Spatial-Analytic) 
and  with  general  ability.  The  complex  relationships  between 
anxiety  and  general  ability  are  well  documented  (Cronbach  & 
Snow,  1977;  Gaudry  &  Spielberger,  1971,  Sieber  et  al.,  1977; 
Snow,  1976).  Consequently,  it  is  not  surprising  that  some 
confounding  between  the  factors  shows  up  in  this  factor 
analysis.  The  only  other  measure  with  an  appreciable 
loading  on  the  anxiety  factor  is  V24.  The  negative  loading 
suggests  that  a  practical  orientation  fits  a  high  anxiety 
tendency  better  than  would  an  imaginative  orientation. 
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For  Factor  4  the  only  measures  with  high  or  appreciable 
loadings  are  those  that  can  be  classified  as  personality 
characteristics.  The  highest  loading  is  for  V19  (Sober  / 
Happy-go-lucky).  It  is  the  "happy-go-lucky"  dimension  that 
loads  highly  on  the  factor.  In  addition,  V19  loads  on  no 
other  factor  so  it  is  factorially  "pure."  The  next  highest 
loading  was  for  V21  and  represents  the  "venturesome" 
dimension  of  the  variable.  This  dimension  of  V21  did  not 
load  on  any  other  factor  but  the  other  dimension  of  the 
variable  (shy)  did  have  a  reasonably  high  loading  on  the 
"ability  to  work  under  stress"  factor.  Since  each  end  of 
the  continuum  for  each  measure  from  the  16PF  represents  a 
different  personality  characteri stic ,  it  could  be  argued 
that  appreciable  positive  and  negative  loadings  for  the  same 
variable,  on  different  factors,  represent  totally  different 
traits  and  not  just  "more"  or  “less"  of  the  same  trait.  If 
this  interpretation  is  accepted,  then  a  variable  that  has 
only  one  appreciable  or  high  positive  loading  (on  one 
factor)  and  only  one  appreciable  or  high  negative  loading 
(on  a  different  factor)  could  still  be  considered 
factorially  "pure."  Such  was  the  case  with  V2 1  and  with 
VI 5,  the  variable  with  the  next  highest  loading  on  Factor  4. 

The  high  positive  loading  on  Factor  4  for  V15  indicated 
that  the  "outgoing"  dimension  of  the  variable  is  factorially 
"pure."  The  other  dimension  of  this  variable  (reserved) 
loaded  with  a  high  negative  loading  on  the 
"spatial-analytic"  factor.  In  both  cases,  the  particular 
dimension  of  the  variable  loaded  on  one  and  only  one  factor. 

The  three  personality  characteristics  just  named  with 
high  loadings  on  Factor  4  ( happy-go- lucxv ,  venturesome,  and 
outgoing)  all  had  loadings  within  .07  cf  one  another  and 
were  factorially  "pure."  The  detailed  descriptions  of  these 
dimensions,  as  described  in  the  test  administration  manual 
(Manual  for  the  16PF,  1972,  pp .  17-22)  suggest  same  common 
threads  that  appear  to  be  emerging  in  this  factor. 
Apparently,  there  is  a  carefree,  emotionally  expressive,  and 
easy-going  nature  to  this  factor.  At  the  same  time,  there 
is  spontaneity--even  to  the  point  of  impulsiveness  and/or 
boldness . 

Appreciable  but  not  high  loadings  on  this  factor  were 
also  observed  for  the  "forthright"  dimension  of  V25,  the 
"group-dependent"  dimension  of  V28  and  for  trait  anxiety. 

The  group-dependent  dimension  loads  only  on  Factor  4,  but 
the  forthright  dimension  loads  on  both  the  "spatial- 
analytic"  factor  and  on  Factor  6.  Trait  anxiety  loads  on 
the  "ability"  to  work  under  stress"  factor  and  also  on 
Factor  6.  A  negative  loading  for  trait  anxiety  suggested 
that  low  trait  anxiety  accompanies  the  easy-going,  carefree, 
and  other  characteristics  that  are  par  of  the  factor.  The 
"forthright"  person  could  be  said  to  be  unreserved, 
unguarded,  or  unrestrained.  He  is  "very  easily  pleased  and 


62 


content  with  what  comes,  and  is  natural  and  spontaneous" 
(Manual  for  the  16PF,  1972,  p.  21).  The  "group-dependent" 
person  "likes  and  depends  on  social  approval  and 
admiration...  and  may  be  lacking  in  individual  resolution 
(Manual  for  the  16PF,  p.  22)." 

It  might  be  said  that  someone  with  a  great  deal  of 
Factor  4  was  unconcerned  by  and  possessed  a  casualness 
toward  danger.  He  would  be  able  to  forge  ahead  in  the  face 
of  danger  in  a  good-natured  way--almost  as  if  he  were 
oblivious  to  the  danger  or  didn't  really  care  about  it. 

Yet,  he  would  still  like  social  approval  and  admiration  for 
being  this  way.  It  is  'in  this  sense  that  he  might  be  called 
group-dependent.  The  lack  of  individual  resolution  that 
characterizes  the  group-dependent  person  can  be  explained  by 
the  rest  of  the  factor  in  that  a  person  with  this  factor  is 
so  spontaneous  and  impulsive  that  action  occurs  without  the 
need  for  any  firm  resolve.  Other  personality  dimensions 
with  smaller  loadings  on  Factor  4  (between  .24  and  .27)  are: 
Imaginative,  Experimenting,  Controlled,  and  Humble. 

It  should  be  noted  that  Factor  4  is  the  only  factor 
which  has  zero  or  near  zero  loadings  for  all  of  the 
intellectual  ability  measures  (general  or  specialized). 
Therefore,  in  this  solution,  it  is  the  only  factor  that  is 
truly  unconfounded  by  any  form  of  general  ability.  A 
carefi.'  inspection  of  the  simple  structure  analysis  suggests 
that  this  factor  is  quite  independent  of  the  other  factors, 
yet  it  is  difficult  to  define  with  one  or  two  words.  The 
component  features  of  the  factor  nave  been  described  and 
some  discussion  has  been  presented  to  tie  together  the 
various  dimensions  of  the  factor  into  a  meaningful 
representation.  However,  an  obvious  name  for  this  factor 
(or  any  of  the  factors  that  follow)  is  not  available.  As  a 
result,  (in  almost  all  cases  throughout  this  report)  if  a 
factor  does  not  have  an  obvious  name  but  it  does  have  one  or 
more  factorially  "pure"  personality  dimensions  loaded  onto 
it,  it  will  be  called  by  the  name(s)  of  the  factorially 
"pure"  dimensions.  In  the  case  of  Factor  4,  it  would  be 
called  the  "happy-go-lucky,  venturesome,  outgoing"  factor. 
However,  if  a  factor  does  not  have  any  factorially  "pure" 
dimensions,  it  will  be  called  by  its  factor  number  alone. 

In  all  cases,  each  factor  will  be  described. 

Factor  5  could  be  called  the  "assertiveness"  factor. 

It  had  two  measures  with  high  loadings:  the  "suspicious" 
dimension  of  V23  and  the  "assertive"  dimension  of  V18. 
Suspiciousness  also  loaded  somewhat  highly  on  the 
"spatial-analytic”  factor.  The  loading  on  Factor  5  for 
suspiciousness  was  clearly  the  highest.  The  "assertive" 
dimension  loaded  only  on  Factor  5  so  it  can  be  said  to  be 
factorially  "pure.”  The  Manual  for  the  16PF  (p.  20) 
explained  the  "suspicious"  dimension  as  "mistrusting  and 
doubtful...,  deliberate  in  actions,  unconcerned  about  other 
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people,  a  poor  team  member."  The  "assertive"  dimension, 
described  on  page  18,  characterizes  a  person  as 
"self-assured,  independent-minded...,  a  law  unto  himself..., 
authoritarian  (managing  others),  and  disregard[ ing] 
authority. " 

Other  personality  measures  with  loadings  on  Factor  5 
between  .32  and  .39  included  the  "practical"  dimension  of 
V24,  the  "astute"  dimension  of  V25,  and  state  anxiety. 
Measures  of  intellectual  ability  with  loadings  in  che  same 
range  were  the  "more  intelligent"  dimension  of  Vlo  and  the 
quantitative  portion  of  the  Thurstone  Test  of  Mental 
Alertness.  Again,  according  to  the  Manual  for  the  16PF  (p. 
20)  the  practical  person  is  "anxious  to  do  the  right 
things,"  is  "subject  to  the  dictation  of  what  is  obviously 
possible...  is  concerned  over  detail,  [and  is]  able  to  keep 
his  head  in  emergencies."  On  page  21  of  the  manual,  the 
astute  person  is  characterized  as  "shrewd...  often 
hardheaded  and  analytical...  [with]  an  intellectual, 
unsentimental  approach  to  situations,  an  approach  akin  to 
cynicism."  Low  state  anxiety  was  associated  with  this 
factor.  Other  measures  with  low  loadings  +.23  and  -.22 
respectively)  were  the  language  scale  of  the  Thurstone  and 
the  Closure  Speed  Test. 

The  sixth  factor  might  be  named  the  "tender-minded, 
conscientious"  factor.  The  description  given  for  the 
"tender-minded"  dimension  of  V22  in  the  manual  suggests  a 
person  who  is  dependent  and  sensitive,  has  high  and  often 
unpredictably  changing  standards,  and  who  is  difficult  to 
please.  This  type  of  person  "tends  to  slow  up  group 
performance,  and  to  upset  group  morale  by  unrealistic 
fussiness  (p.  20)."  The  loading  of  .78  for  the 
"tender-minded"  dimension  of  V22  on  this  factor  was  the  only 
loading  at  all  for  the  variable.  As  a  result,  it  can  be 
said  to  be  factorially  "pure." 

No  other  variable  has  a  loading  approaching  the 
magnitude  of  that  for  "tender-minded"  on  Factor  6.  However, 
the  "conscientious"  dimension  of  V20  does  cleanly  load  on 
the  factor  with  an  appreciable  but  not  high  loading  of  .47. 
The  Manual  for  the  16PF  (1972,  p.  19)  describes  a  person 
with  this  dimension  as  "exacting  in  character,  dominated  by 
a  sense  of  duty,  persevering,  responsible,  ...,  and 
moralistic...  [with  an]  inner  'categorical  imperative'  ..." 
The  descriptions  for  the  two  factorially  "pure"  dimensions 
for  Factor  6  are  quite  compatible  with  one  another  and 
depict  a  unified  representation  of  the  factor. 

The  only  other  variable  with  a  reasonably  clean  loading 
on  this  factor  is  the  "controlled"  dimension  of  V29.  It 
loaded  on  only  one  other  factor  (the  "happy-go-lucky, 
venturesome,  outgoing"  factor),  but  that  loading  was  less 
than  .3.  A  "controlled"  person  is  described  in  the  manual 
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(p.  22)  as  having  "strong  control  over  his  emotions  and 
general  behavior,"  as  "evidenc[ ing]  what  is  commonly  termed 
'self-respect'  and  regard  for  social  reputation.  He 
sometimes  tends,  however,  to  be  obstinate."  Such  comments 
complement  the  notions  of  dependent  and  sensitive  suggested 
by  " tender-mindedness . "  Other  measures  which  load  less 
cleanly  on  this  factor  include:  state  and  trait  anxiety 
(both  negatively  but  with  state  anxiety  of  much  greater 
magnitude),  forthrightness,  language  Thurstone  (positively), 
and  self-sufficiency. 


The  seventh  factor  can  only  be  called  Factor  7,  and  its 
interpretation  is  difficult.  Not  until  the  third  measure 
(in  order  of  the  magnitudes  of  the  loadings)  is  there  a 
factorially  "pure"  variable--the  "expedient"  dimension  of 
V20.  The  loading  on  "expediency"  is  considerably  lesa  than 
loadings  for  other  measures  on  other  factors  in  almost  all 
cases.  In  addition,  the  highest  loading  for  Factor  7  is 
lower  than  the  highest  loading  for  each  of  the  other 
factors.  Nevertheless,  in  Factor  7,  there  are  four  measures 
with  loadings  of  .5  or  greater  on  Factor  7,  which  is  more 
variables  with  high  loadings  than  for  some  other  factors 
already  identified.  Hopefully,  the  discussion  just 
presented  will  help  to  explain  why  the  factor  cannot  be  even 
tentatively  "named"  and  why  it  was  still  important  enough  to 
retain  in  the  solution. 

For  Factor  7,  the  "experimenting"  dimension  of  V27 
leaded  first  but  it  has  appreciable  loadings  of  between  .2 
and  .3  on  both  the  "spatial-analytic"  and  the 
"happy-go-lucky,  venturesome,  outgoing"  factors.  The 
"self-sufficient"  dimension  of  V29  loaded  next  highly  but  it 
also  loaded  with  ,2  on  the  "tender-minded,  conscientious" 
factor.  The  "imaginative"  dimension  of  V 24  loaded  almost 
cleanly  with  a  coefficient  of  .51  but  it  did  have  another 
loading  (  .28)  on  the  "ability  to  work  under  stress"  factor. 

Closure  speed,  emotionally  stable,  and  self-assured  each 
had  loadings  of  between  .22  and  .27  on  Factor  7. 

Following  the  completion  of  all  factor  analyses,  the 
independent  and  dependent  variables  were  submitted  to 
canonical  correlation  analysis.  The  independent  variables 
were  entered  as  the  first  set  with  the  dependent  variables 
as  the  second  set.  There  were  no  significant  canonical 
correlations  between  pairs  of  canonical  variates.  However, 
it  was  suspected  that  general  ability  masked  the  effects  of 
other  variables  crucial  to  the  performance  of  the  REDEYE 
task.  (See  the  factor  analysis  discussion  on  pages  57-65 
with  particular  reference  to  page  60,  lines  13,  14,  15.)  A 
summary  of  the  canonical  correlation  analysis  is  presented 
in  Table  24.  The  summary  table  includes  the  following 
information:  (a)  the  magnitudes  of  the  eigenvalues,  (b)  the 

canonical  correlations,  (c)  Wilk's  lambda,  (d)  chi-square 
values,  (e)  the  degrees  of  freedom,  (f)  the  probability 
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levels  for  significance,  and  (g)  two  matrices  of 
standardized  canonical  variate  coefficients,  one  for  each  of 
the  two  sets  of  variables  submitted  to  analysis. 

To  investigate  the  masking  influence  of  general 
ability,  a  second  canonical  correlation  was  performed.  This 
second  canonical  involved  a  restricted  number  of  variables 
(both  independent  and  dependent)  as  compared  to  the  first 
analysis.  Only  those  variables  were  selected  which  had 
canonical  variate  coefficients  greater  than  |.30|  in  the 
first  analysis.  This  restriction  effectively  removed  those 
variables  which  were  not  providing  independent  variance  to 
the  canonical  correlation.  Since  this  was  an  exploratory 
study,  i . 3 0 1  was  selected  as  the  lower  limit  of  interest  as 
a  coefficient  of  less  than  | . 3 0 1  would  suggest  small 
independent  contribution  to  the  variance  (Smith,  1980). 

Nine  of  the  twenty-nine  variables  of  the  first  set  and 
three  of  the  six  variables  of  the  second  set  met  the 
criterion  and  were  submitted  to  the  second  anavsis.  In  this 
analysis,  a  significant  canonical  correlation  of  .758  was 
observed  for  the  first  pair  of  canonical  variates  (p  <.001). 
This  indicated  that  general  ability,  as  a  component  of 
several  of  the  factors,  confounded  the  first  analysis.  A 
summary  of  the  results  of  the  second  canonical  correlation 
analysis  is  presented  in  Table  25.  The  types  of  information 
shown  in  Table  25  are  identical  to  those  in  Table  24. 

For  interpretation  purposes,  the  eigenvalues  indicate 
the  proportion  of  variance  shared  by  the  pair  of  canonical 
variates  to  which  each  eigenvalue  corresponds.  In  this 
case,  57%  of  the  variance  is  shared  by  the  pair  of  canonical 
variates,  each  of  which  is  a  unique  combination  of  the 
original  variables  that  are  part  of  each  respective  set. 

The  size  of  the  coefficients  for  the  variables  that  make  up 
each  canonical  variate  indicates  the  relative  contributions 
of  the  original  variables  to  the  composition  of  the  variate. 

In  this  analysis,  the  most  important  variable  to  the 
first  variable  set  was  V4  (Color  Naming  with  Distraction 
from  the  Press  Test),  followed  in  order  by  V3  (Color 
Naming),  V16  (16PF-FB:  Less  Intelligent/More  Intelligent), 
Vll  (Pursuit),  V5  (Closure  Flexibility),  V25  ( 16PF-FN : 
Forthright/Astute),  V30  (16PF-FQ4:  Relaxed/Tense),  V22 
( 16PF-FI :  Tough-minded/Tender-minded ) ,  and  V10  (GEFT).  In 
the  second  set,  the  variable  that  contributed  most  to  the 
variate  was  V39  (Range  Ring  Profile  Written  Retention  Test), 
followed  by  V37  and  V36  respectively.  V37  was  the  Film  10 
Performance  Retention  Test  while  V36  was  the  immediate  Range 
Ring  Profile  Written  Test. 

Each  canonical  correlation  coefficient  can  be 
interpreted  as  a  Pearson  product-moment  coefficient 
except  that  the  measure  of  relationship  for  the  former 
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refers  to  that  between  the  two  variates  while  the  latter 
refers  to  a  relationship  between  two  individual  variables. 

The  next  step  in  the  analysis  was  to  calculate 
canonical  variate  scores  for  each  individual  case  in  the 
REDEYE  sample.  A  summary  of  the  means  and  standard 
deviations  of  these  standardized  scores,  grouped  by  aptitude 
profile,  is  presented  in  Table  26. 


At  first  glance,  there  are  marked  differences  between 
the  canonical  variate  scores  on  both  variable  sets  for  those 
with  Aptitude  Profile  1  and  those  with  Aptitude  Profile  3. 

To  thoroughly  inspect  these  and  any  other  differences,  new 
scores  for  each  of  the  variables  that  went  into  each 
canonical  variate  (adjusted  for  the  relative  contribution  to 
the  variate)  should  be  calculated  for  each  case.  To  do  this 
would  have  been  beyond  the  scope  of  the  research  for  the 
present  contract  and  could  be  the  subject  of  further 
analyses  at  a  later  date. 


Instead,  theoretical  and  logical  considerations  were 
applied  to  the  interpretation  of  output  results  from  the 
canonical  correlation  analysis  of  Table  25  (see  Appendix  S). 
These  interpretations  were  made  in  light  of  aptitude 
profiles  wherever  possible. 

Results .  The  results  of  the  REDEYE  exploratory  factor 
analyses  are: 

1.  There  is  not  a  truly  general  intellectual  ability 
factor  that  emerges  in  the  REDEYE  sample.  Rather, 
the  intellectual  ability  factor  that  does  emerge  is 
more  specialized;  namely,  "spatial-analytic." 

2.  The  underlying  factors  that  characterize  men  who 
remain  in  REDEYE  field  units  well  after  the 
completion  of  AIT  training  (or  equivalent)  are,  in 
order  of  importance:  "spatial-analytic,"  "ability 
to  work  under  stress,"  "anxiety,"  "happy-go-lucky, 
venturesome,  outgoing,"  "assertiveness,"  "tender- 
minded,  conscientious,"  and  one  unnamed  factor. 
Together,  the  first  four  factors  explain  just  under 
50%  of  the  total  variance  while  all  seven  explain 
almost  67%. 


The  results  of  the  canonical  correlation  analyses  are: 

1.  General  ability  is  a  crucial  factor  in  REDEYE 
performance,  the  effects  of  which  mask  other 
factors,  also  crucial  to  performance. 


2  . 


While  "spatial-analytic"  ability  appears 
predict  who  remains  in  REDEYE  units,  the 
the  canonical  analysis  suggest  that  when 


to  best 
results  of 
the 
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TABLE  26 


SUMMARY  OF  MEANS- AND  STANDARD  DEVIATIONS  OF  CANONICAL  VARIATE  SCORES 
BY  APTITUDE  PROFILE  (BASED  ON  THE  SOLUTION  OF  TABLE  25) 


APTITUDE 

PROFILE 

Canonical 
Score  from 

Variate 
first  set 

Canonical  Variate 

Score  from  secord  set 

X 

SD 

X 

SD 

1  (n  =  14  ) 

1 .100 

.819 

.726 

.538 

2  (n  =  5) 

.484 

.770 

.399 

1  .170 

3  (n  =  28) 

-.607 

.685 

-.484 

.921 

4  (n  =  14) 

-.05? 

.773 

.099 

.999 
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masking  effects  of  general  ability  are  taken  into 
consideration,  "the  ability  to  work  under  stress" 
best  predicts  REDEYE  performance,  particularly  for 
retention.  The  "spatial-analytic"  component  is  the 
next  best  predictor  of  performance,  followed  by  the 
"happy-  go-lucky,  venturesome,  outgoing"  component 
the  "anxiety"  component  and  finally  the 
"tender-minded,  conscientious"  component.  Elements 
of  no  other  identified  factors  (from  the  earlier 
factor  analysis)  were  predictive  of  REDEYE 
performance.  (Appendix  E) 

3.  The  results  of  the  canonical  correlation  analyses 
support  the  existence  of  the  aptitude  profiles  that 
were  established  in  both  the  confirmatory  phase  of 
the  REDEYE  study  and  in  the  earlier  Sullivan  et 

al.  (1978)  studies.  This  was  demonstrated  by  the 
distribution  of  the  canonical  variate  scores  across 
aptitude  profiles  and  by  the  fact  that  at  least  one 
of  the  two  measures  for  each  construct  that  made  up 
each  aptitude  profile  survived  into  the  second 
canonical  correlation  analysis.  The  measures  which 
were  used  to  establish  aptitude  profiles  during  the 
confirmatory  analysis,  which  were  also  a  part  of 
the  significant  canonical  variate  pair,  were:  V5 
(Closure  Flexibility),  V10  (GEFT),  Vll  (Pursuit), 
V16  (16PF-  FB),  and  V30  (16PF-FQ4). 

4.  The  presence  of  two  "ability  to  work  under  stress" 
variables  (V3  &  V4 )  in  the  final  canonical  analysis 
suggests  that  the  ability  to  work  under  stress  may 
be  as  important  to  aptitude  profiles  as  are  the 
other  components  of  the  aptitude  profiles. 
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CHAPTER  IV 


CHAPARRAL  AND  VULCAN  TRAINING  ANALYSIS 

CHAPARRAL  is  a  self-propelled,  short-range,  surface-to- 
air,  infrared  seeking  guided  missile  system  which  provides 
air  defense  to  forward  combat  elements  against  low  altitude 
air  threats.  The  CHAPARRAL  weapon  system  consists  of  a 
launching  station  (M54)  mounted  on  an  unarmored, 
full-tracked  vehicle  (M730).  The  launching  station  can  be 
removed  and  used  independently  of  the  M730  carrier.  In 
either  configuration,  the  missile  launch  station  carries  12 
missiles,  four  on  the  launch  rails  and  eight  in  storage 
compartments.  The  CHAPARRAL  squad,  consisting  of  five  men: 
a  squad  leader,  senior  gunner,  prime  mover  driver,  and  two 
gunners,  is  needed  to  operate  the  system.  Within  any  given 
unit  qualified  CHAPARRAL  crewmen  should  be  able  to  expertly 
perform  the  duties  of  their  own  assigned  duty  position  as 
well  as  those  of  all  other  squad  positions  (FM  44-3,  1977; 

FM  44-4,  1971 ) . 

VULCAN  is  an  air  defense  gur.  system  that  is  used  to 
counter  low-altitude  air  threats.  It  is  effective  against 
high-performance  aircraft,  slower  fixed-wing  aircraft,  and 
helicopters  that  are  within  its  range  capabilities.  It  can 
also  be  used  to  provide  ground  fires  under  certain 
conditions.  VULCAN  comes  in  two  versions:  the 
Self-Propelled  (S?)  VULCAN  and  the  Towed  VULCAN.  Both 
versions  consist  of  a  6-barrel,  20-mm  Gatling-type  gun 
(cannon)  with  variable  firing  rate  capability,  an  onboard 
Range-Only  Radar  (ROR)  system  that  provides  information  for 
the  fire  control  system,  and  a  mount  appropriate  to  the 
particular  version  of  the  weapon.  The  SP  VULCAN's  cannon  is 
mounted  on  a  full-tracked  M741  carrier,  while  the  towed 
VULCAN  gun  system  is  mounted  on  an  M42  gun  carriage,  which, 
m  turn,  is  typically  attached  to  a  two-wheel  trailer 
carriage.  The  towed  version  is  usually  moved  by  a  1  1/4  ton 
truck,  the  M561  Gama  Goat,  but  can  also  be  moved  by  other 
vehicles.  The  towed  VULCAN  carries  less  ready-to-f ire 
ammunition  than  the  SP  VULCAN.  Either  VULCAN  gun  system  is 
manned  by  a  squad  of  four  men:  a  squad  leader,  senior 
gunner,  prime  mover  driver,  and  gunner.  As  with  the 
CHAPARRAL  system,  qualified  VULCAN  crewmen  in  any  given  unit 
should  be  able  to  expertly  perform  all  of  the  duties  of 
their  own  and  all  other  squad  positions  (FM  44-3,  1977;  FM 
44-100,  1970). 

CHAPARRAL  or  VULCAN  squads  are  similarly  organized  into 
platoons  with  four  squads  per  platoon.  A  CHAPARRAL  or 
VULCAN  battery,  in  turn,  consists  of  three  platoons.  An  air 
defense  artillery  (ADA)  CHAPARRAL /VULCAN  (C/V)  battalion 
consists  of  two  SP  VULCAN  batteries  and  two  CHAPARRAL 
batteries  along  with  all  the  other  logistical  and  admin¬ 
istrative  support  normally  attached  to  an  ADA  battalion. 
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The  purpose  of  the  C/V  analysis  was  to  identify  areas 
of  training  difficulty  in  current  Advanced  Individual 
Training  (AIT)  programs,  to  analyze  current  AIT  performance 
data  as  a  function  of  population  specific  aptitude  patterns, 
and  to  synthesize  both  sets  of  information  in  order  to  be 
able  to  suggest  possible  population  specific  instructional 
strategy  applications  for  some  of  the  critical  tasks  that 
C/V  crewmen  must  perform. 

If  the  aptitude  patterns  in  the  CHAPARRAL  and  VULCAN 
samples  which  best  explained  AIT  performance  were  the  same 
or  similar  to  the  aptitude  profiles  identified  in  the  REDEYE 
Study,  there  would  then  be  some  support  for  the  general- 
izability  of  those  profiles  across  tasks.  If  this  occurred, 
it  would  suggest  that  the  instructional  strategies  designed 
for  REDEYE  gunners  with  the  different  aptitude  profiles 
might  also  be  applicable  to  CHAPARRAL  and  VULCAN  crewmen  who 
had  the  same  profiles. 

However,  if  the  already  identified  aptitude  profiles 
did  not  exist  in  the  CHAPARRAL  and  VULCAN  samples,  then  it 
would  be  necessary  to  investigate  the  relationships  between 
aptitude  measures  from  the  entire  test  battery  and  the 
various  kinds  of  C/V  AIT  performance.  The  results  of  such 
an  investigation  would  theoretically  point  toward  other 
aptitude  profiles  that  would  be  empirically  related  to 
criterion  performance  specific  to  CHAPARRAL  and  VULCAN. 
Research  on  instructional  strategies  for  people  with  varying 
levels  of  the  aptitudes  for  the  "new"  profiles  would  then  be 
synthesized  in  order  to  suggest  unique  strategies  for  C/V 
trainees  who  had  these  newly-suggested  profiles . 

Current  Advanced  Individual  Training  (AIT) 

The  general  consensus  from  the  instructors  interviewed 
at  the  Air  Defense  School  at  Fort  Bliss,  Texas  was  that 
individuals  completing  AIT  for  CHAPARRAL  (16P)  or  VULCAN 
(16R)  could  not  perform  the  duties  at  all  squad  positions 
expertly,  nor  were  they  expected  to  do  so.  In  fact,  in  most 
cases,  all  C/V  trainees  were  never  even  given  the  oppor¬ 
tunity  to  practice  duties  at  every  position,  let  alone 
become  proficient  at  every  position.  Indeed,  the  function 
of  C/V  AIT  is  apparently  to  set  the  foundations  of  knowledge 
in  the  MOS  and  not  to  perfect  squad  level  performance. 

There  are  many  differences  of  opinion  though,  on  just  how 
much  (or  little)  "ought"  to  be  expected  for  AIT  performance. 

Some  C/V  AIT  instructors  had  previously  been  squad 
leaders  in  the  field.  As  squad  leaders  responsible  for  the 
efficient  operation  of  a  fire  unit  and  the  training  of  other 
squad  members,  these  AIT  instructors  had  expected  that  their 
new  squad  members  would  have  had  more  knowledge  and  skill  at 
each  squad  position  than  was  evident  when  the  men  had 
reported  for  duty,  from  AIT.  As  AIT  instructors,  these  same 
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men  stated  that  it  was  impossible  to  train  new  AIT  trainees 
to  the  proficiency  level  that  would  be  necessary  to  maintain 
an  acceptable  unit  proficiency  in  the  field.  They  indicated 
that  only  the  squad  leader  in  each  unit  could  provide  enough 
individual  assistance  to  squad  members  to  allow  expert 
proficiency  at  each  position  to  be  reached  by  all  squad 
members . 

These  instructors  recognized  the  difficulties  inherent 
in  both  AIT  and  unit  level  training  because  they  were 
experienced  in  both.  They  also  conceded  that  today's  AIT 
candidate  is  more  difficult  to  train  than  was  yesterday's, 
and  that  many  tasks  that  are  most  critical  to  efficient 
CHAPARRAL  or  VULCAN  performance  were  not  emphasized  enough 
in  AIT.  These  same  tasks,  if  they  were  practiced  in  AIT, 
were  often  not  evaluated  by  the  same  high  standards  as  they 
would  be  if  they  were  being  tested  in  a  field  unit. 
Sometimes,  they  were  not  evaluated  at  all  in  AIT. 

Emphasis  for  the  present  research  was  to  be  given  to 
the  identification  of  complex  procedural  tasks  performed 
under  temporal  stress  and  to  the  determination  of  their 
significance  to  weapon  system  effectiveness.  According  to 
the  AIT  instructors  interviewed,  and  from  selected 
observations  of  AIT  made  by  the  investigators,  critical 
procedural  tasks  that  must  be  performed  under  time  pressure 
are  not  present  in  current  AIT.  The  emphasis  for  such 
critical  tasks  in  AIT  is  on  safety  and  knowledge  of  the 
procedure(s)  rather  than  on  performance  according  to  the 
timed  unit  level  standard. 

Temporal  stress  appears  to  be  critical — but  not  in  AIT. 
Temporal  stress  apparently  does  not  enter  into  the 
performance  equation  until  the  AIT  graduate  reaches  his 
first  assignment  in  the  field.  This  lack  of  experience  in 
performing  critical  procedural  team  tasks  under  a  time 
pressure  could  be  the  reason  for  the  low  level  of  unit 
proficiency  in  the  field.  The  new  squad  members  are  faced 
with  a  new  demand  that  had  previously  been  optional.  Not 
only  do  they  have  to  do  everything  right  and  safely,  (as  in 
AIT),  but  they  also  have  to  do  it  within  a  time  limit  (now 
that  they  are  attached  to  a  field  unit).  When  behaviors 
that  are  taught  do  not  match  the  behaviors  that  are 
expected,  it  is  not  surprising  that  many  people  do  not  meet 
the  expectations.  Perhaps  some  level  of  time  pressure 
should  be  placed  on  AIT  students  for  at  least  some  of  the 
critical  tasks  so  that  such  pressure  is  not  totally  new  when 
they  reach  their  first  unit  assignment. 

There  was  general  agreement  among  all  AIT  instructors 
that  these  complex  procedural  tasks  performed  under  a  time 
t  pressure  were  the  most  important  determiners  of  weapon 

system  effectiveness.  Yet,  this  very  important  component 
was  left  out  of  AIT  training,  almost  completely. 
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Prerequisite  to  performing  these  complex  tasks  under 
time  pressure,  a  soldier  has  to  know  a  vast  amount  of 
cognitive  information  about  the  weapon  system.  I f  he  does 
not  know  the  various  parts  to  his  equipment  and  how  each  one 
functions,  he  would  find  it  difficult  to  carry  out  any  one 
of  a  number  of  complex  procedures.  It  was  clear  that  the 
cognitive  demand  placed  on  C/'V  crewmen  was  greater  than  that 
placed  on  REDEYE  gunners,  at  least  in  some  areas. 

In  CHAPARRAL  AIT,  emphasis  is  placed  on  learning: 

•  the  components  that  make  up  the  system 

•  visual  aircraft  recognition 

•  how  to  pre-energize  and  energize  the  launch  station 

•  how  to  perform  maintenance  on  the  various  components 
of  the  system 

•  how  to  Load  and  unload  missiles 

•  how  to  maintain  effective  communications 

•  how  to  do  map  reading 

•  how  to  track  and  engage  aircraft  while  in  the  mount 

•  how  to  execute  squad  drills 

The  last  item  noted  above  is  considered  the  most  important 
one  tc  know  how  to  do,  yet  it  is  the  only  one  that  is 
considered  optional  during  AIT  training.  There  is  seldom 
enough  time  during  AIT  to  be  able  to  practice  squad  drills 
Many  trainees  never  practice  squad  drills  until  they  reach 
their  first  assignment. 

In  VULCAN  AIT  training,  emphasis  is  placed  on  learning: 

•  the  component  parts  of  the  system 

•  visual  aircraft  recognition 

•  how  to  do  boresighting  and  alignment 

•  how  to  change  radar  frequency 

•  how  to  operate  the  vehicle 

•  how  to  fire  the  weapon  itself 

•  how  to  load  and  unload  ammunition  to  the  storage 
drum 

More  "hands-on"  practice  seemed  to  be  given  to  loading 
ammunition  than  to  any  other  skill  area.  However, 
boresighting  and  changing  radar  frequency  were  considered  as 
the  two  most  important  performances,  with  loading  almost  as 
important.  In  addition,  actual  operation  of  the  vehicle  was 
considered  essential  for  acceptable  proficiency. 

For  both  CHAPARRAL  and  VULCAN,  both  written  and 
proficiency  testing  was  done,  but  more  confidence  seemed  to 
be  placed  in  written  testing  than  in  performance  testing. 
Instructors  claimed  that  "hands-on"  performance  was  most 
important.  However,  in  practice,  they  seemed  to  base  their 
judgments  about  trainees  more  on  written  performance  than  on 
performance  during  proficiency  testing. 
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It  was  also  determined  that  a  trainee  was  seldom  failed 
aftei  proficiency  testing  if  he  had  "tried  hard"  and  if  he 
was  cooperative  as  a  team  member— even  if  he  did  not  meet 
the  established  proficiency  criteria.  This  was  especially 
true  if  he  had  done  well  on  written  testing  that  covered 
similar  content  material.  The  consensus  among  AIT 
instructors  suggested  that  motivation  and  ability  to  work  on 
a  team  were  the  most  important  aspects  of  being  a  successful 
C.'V  crewman.  A  considerable  number  of  the  critical  tusks 
for  both  weapon  systems  demands  the  efforts  of  more  than  one 
person  at  a  time,  so  team  work  is  essential  for  acceptable 
performance . 

Methodology 

The  Population 

The  samples  consisted  of  several  16P  and  16R  AIT 
classes  in  training  at  Fort  Bliss,  Texas,  during  July  and 
August  of  1979.  Independent  measures  were  collected  on  36 
16P  men  during  July  and  37  more  during  August  for  a  total  of 
73  16P  soldiers.  By  the  time  all  dependent  measures  had 
91  been  collected,  the  number  of  subjects  for  whom  there  was 

complete  (or  almost  complete)  data  was  67.  These  67 
soldiers  represented  the  CHAPARRAL  population. 

During  July  1979,  independent  measures  were  collected 
on  25  16R  soldiers.  The  same  measures  were  collected  for  69 
other  men  during  August  for  a  total  of  94  16R  soldiers.  By 
the  time  all  dependent  measures  for  these  men  had  been 
collected,  there  was  complete  (or  almost  complete)  data  on 
only  61  of  them.  These  61  soldiers  represented  the  VULCAN 
sample . 

For  both  CHAPARRAL  and  VULCAN,  the  number  of  cases  that 
could  be  analyzed  would  vary  greatly,  depending  on  which 
measures  might  be  submitted  for  analysis.  So  that  all 
analyses  could  be  performed  on  the  same  data,  it  was  decided 
to  utilize  only  those  cases  in  each  of  the  C/V  samples  for 
whom  there  were  complete  aptitude  test  scores.  Army 
dependent  measure  scores,  and  rating  scale  measures 
(designed  by  the  investigators).  Explanations  for  the 
various  measures  follow. 

Measuring  Instruments  for  Aptitudes 

The  same  battery  of  aptitude  .ests  was  given  to  both 
16P  and  16R  trainees.  It  consisted  of  all  of  the  measures 
used  in  the  aptitude  battery  for  the  REDEYE  Study  plus  the 
Guil ford-Zimmerman  Test  of  Perceptual  Speed.  This  test  is 
one  subtest  of  the  Guilfo-d-Zimmerman  Aptitude  Survey.  It 
tests  the  "ability  to  perceive  detailed  visual  objects 
quickly  and  accurately"  (Guilford  &  Zimmerman,  1956,  d.2). 
Independent  measures  collected  from  the  Army  included  the 
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Armed  Forces  Qualification  Test  ( AFQT )  and  the  12  raw  scores 
from  the  Armed  Services  Vocational  Aptitude  Battery  (ASVAB). 
See  Chapter  III  for  explanations  of  those  measures  that  are 
identical  to  the  ones  used  in  the  REDEYE  Study.  See 
Bloedorn  (1979)  for  explanations  of  the  measures  collected 
from  the  Army.  See  Table  27  for  a  short  summary  of  all 
independent  variables  for  the  16P  and  16R  analyses. 

Included  on  the  table  is  the  variable  name  used  for  computer 
input,  the  label  associated  with  each,  variable  name,  and  an 
extended  label  that  more  clearly  identifies  each  variable 
(when  applicable). 


Dependent  Measures 


When  faced  with  the  task  of  identifying  dependent 
measures  that  would  be  sensitive  to  actual  differences  in 
written  and  proficiency  performance,  and  which  could 
accurately  measure  the  competencies  thought  to  be  critical 
for  C/V  crewmen,  the  investigators  learned  that  existing  C/V 
dependent  measures  often  did  not  test  the  areas  of  interest 
independently  or  objectively.  For  example,  boresighting  was 
considered  one  of  the  most  important  VULCAN  crew 
competencies,  but,  in  a  written  test  of  that  content,  there 
were  also  items  concerning  changing  radar  frequency,  water 
crossing  operations,  and  the  M561  Gama  Goat.  The  data 
collected  from  the  AIT  instructors  did  not  distinguish 
between  subscores  on  the  tests.  Consequently,  inferences 
about  what  might  predict  success  in  boresighting  would  be 
difficult  to  make  because  of  the  contaminated  nature  of  the 
written  measure  concerning  it.  There  were  other  problems 
with  the  performance  measures  for  boresighting  (or  any  other 
area  for  VULCAN). 


All  VULCAN  skill  performance  measures  we'-e  in  the  form 
of  proficiency  tests.  There  were  four  proficiency  tests  and 
a  final  proficiency  test.  Within  each  proficiency  test  were 
two  or  three  independent  subtests.  Even  though  each  subtest 
was  independent  of  any  other,  the  scoring  consisted  of  a 
somewhat  nebulous  "go"  or  "no  go"  for  each  subtest.  A  "go" 
meant  that  the  trainee  performed  an  entire  series  of  from  15 
to  45+  steps  correctly  (depending  on  the  subtest) — all  on 
the  first  try.  A  "no  go"  meant  that  a  trainee  had  performed 
at  least  one  of  the  15-45+  steps  improperly  on  the  first 
try.  It  could  have  meant  that  he  performed  more  than  one 
step  incorrectly. 

There  was  often  no  way  to  determine  whether  a  soldier 
had  performed  all  of  the  steps  in  a  long  series  (except  the 
last  one)  correctly,  or  if  he  had  started  out  wrong,  never 
even  knowing  how  to  begin.  Although  actual  proficiency  in 
both  cases  would  be  measured  as  "no  go,"  it  is  clear  that 
the  two  levels  of  performance  would  be  entirely  different. 


TABLE  27 


SUMMARY  OF  INDEPENDENT  VARIABLES  COLLECTEE  FROM 
16P  AND  1GR  TRAINEES 


i  r  i  a  b  I  e 
Name 

Variable 

Label 

Extended 

Label 

V 1 

Age 

V2 

lord 

From  the  Press  Test 

V  j. 

Ccicr 

From  the  Press  Test 

V-r 

Nintc 

From  the  Press  Test  (Ccicr  naming 

with  distraction) 

V5 

Cl f lex 

Closure  Flexibility 

VG 

Cl  spd 

Closure  Speed 

V  7 

LTH 

Language  Thurstone 

Vb 

GTE 

Quantitative  Thurstone 

vs 

TTH 

Total  Thurstone 

VIC. 

GEFT 

Group  Embedded  Figures  Test 

VI 1 

Pursuit 

From  Mac Cuarrie  Test 

VI  2 

State 

State  Anxiety 

Vi  3 

Trait 

Trait  Anxiety 

Vi  4 

2c  in 

Two  Eimensional  Spatial  Relations 

Vi  5 

FA 

Reserved/ Outgoing 

V 1 G 

FB 

Less  Intel 1/More  Ir.tell 

Vi  7 

FC 

Affected  by  feelings/Emctionolly 

Stable 

VI  b 

FE 

Humble/ Assertive 

VIS 

FF 

Sober /Happy -go- lucky 

V2C 

FG 

Expedient/ Conscientious 

V21 

FH 

Shy/ Venturesome 

V2  2 

FI 

Tough-mi need /Tender-minded 

t  ;  n  ' 

•*  t.  — 

FL 

Trust inc/Suspicious 

V2<+ 

FE 

Practical/ Imaginative 

V2  5 

FN 

Fo rth right /As  tut e 

V2G 

FO 

Self -Assured/ Apprehensive 

V2  7 

Cl 

Conservative/ Experimenting 

V2b 

C2 

G roup- dependent/ Self-sufficient 

V2S 

G3 

Undisciplined  Self- conflict/ 

Controlled 

V30 

Q4 

Relaxed/Ter.se 

V4C 

GZ  PS 

Guilford  Zimmerman  Perceptual  Speed 

AR1 

AFGT 

Armed  Forces  Qualification  Test 

AR2 

GI 

General  Information 

AR  j 

N'C 

Numerical  Operations 

AK4 

AE 

Attention  to  retail 

AR5 

wk 

Word  Knowledge 

ARG 

AR 

Arithmetic  Reasoning 

AR  7 

3P 

Space  Perception 

ARb 

::k 

Mathematics  Knowledge 

ARS 

EI 

Electronics  Information 

AR  1 0 

MC 

Mechanical  Comprehens ion 

AR1 1 

GS 

General  Science 

ARi  2 

SI 

Shop  Information 

AR1  3 

A I 

Automotive  Information 
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The  scoring  of  proficiency  testing  was  observed 
in  selected  instances  for  both  CHAPARRAL  and  VULCAN  at  Fort 
Bliss.  From  those  observations,  it  was  learned  that  there 
was  a  very  subjective  element  present  within  each  testing 
situation  observed— namely,  the  instructors  allowed  certain 
mistakes  to  be  made  without  recording  a  "no  go"  while  other 
mistakes  were  never  allowed.  The  most  critical  errors 
seemed  to  always  result  in  a  "no  go,"  but  the  less  serious 
errors  were  seldom  documented  anywhere  on  the  rating  form. 
Conceivably,  two  trainees  could  both  receive  a  "go"  for  one 
proficiency  subtest,  but  their  actual  proficiency  would  not 
have  been  identical.  For  one  of  the  men  the  "go"  may  have 
been  the  result  of  no  errors  (critical  or  trivial),  while 
for  the  other,  a  "go"  could  have  been  the  result  of  5  out  of 
30  possible  mistakes,  none  of  which  were  serious  enough  to 
cause  the  trainer  to  mark  "no  go."  Such  ratings  were  based 
on  the  trainer's  own  subjective  opinion  of  the  importance  of 
specific  items  to  overall  proficiency.  These  imprecise 
measures  for  proficiency  performance  existed  for  both 
CHAPARRAL  and  VULCAN,  although  the  situation  for  the  VULCAN 
tests  seemed  more  serious. 

On  the  CHAPARRAL  proficiency  tests,  the  scoring  was 
slightly  different,  but  also  difficult  to  interpret.  Each 
proficiency  test  consisted  of  about  20-45  different 
activities  which  may  or  may  not  have  been  procedurally 
connected  to  one  another.  If  the  trainee  could  perform  all 
of  the  steps  correctly  on  the  first  try,  he  received  a  score 
of  ICO.  If  he  could  not  get  them  all  right  until  the  second 
attempt,  he  received  a  score  of  90 .  A  score  of  80  points 
was  given  if  he  got  everything  right  after  three  tries.  If 
it  took  four  or  more  tries  to  get  everything  right,  the 
soldier  received  70  points. 

As  with  VULCAN  proficiency  testing,  there  was  seldom  a 
way  to  distinguish  between  different  levels  of  proficiency 
with  the  available  measures.  Soldiers  who  each  received 
identical  scores  of  90  could  have  had  very  different  levels 
of  expertise  on  their  first  attempt.  First  attempt  written 
and  proficiency  performance  had  been  of  principal  interest 
because  that  level  of  performance  would  have  had  the 
clearest  implications  for  possible  changes  in  instructional 
strategies.  It  was  not  possible  to  get  precise  first 
attempt  measures.  Because  precise  measures  of  performance 
were  not  an  integral  part  of  AIT  training,  it  was  realized 
that  it  could  be  very  difficult  to  pinpoint  the  exact  areas 
of  training  difficulty.  Nevertheless,  every  effort  was  made 
to  utilize  the  available  performance  measures  in  as 
judicious  a  way  as  possible. 

In  addition,  a  series  of  rating  scales  were  developed 
that  were  intended  to  provide  dependent  measures  on  some  of 
the  other  critical  areas  identified  as  important  by  the  AIT 
instructors.  The  rating  scales  included  measures  for 
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.motivation,  ability  to  work  as  a  team  member,  decisiveness, 
ability  to  work  under  stress,  verbal  ability,  and  overall 
performance.  Explanations  of  each  scale  and  exact  copies  of 
the  forms  are  presented  in  Appendix  F.  The  rating  scales 
were  fashioned  after  those  in  Kelly,  Wooldr idge ,  Hennessy, 
Vreuls,  Barnebey,  Cotton,  and  Reed  (1979).  It  had  been 
intended  that  two  different  supervisors  complete  a  rating 
form  on  each  trainee--his  drill  sergeant  and  one  AIT 
instructor.  In  practice,  only  the  drill  sememes  completed 
the  forms . 

For  CHAPARRAL,  drill  sergeants  rated  almost  all 
soldiers  in  the  sample.  This  was  not  true  for  VULCAN.  At 
least  one  drill  sergeant  refused  to  complete  the  forms  and 
data  on  ratings  for  VULCAN  trainees  were  collected  on  only 
61  of  the  88  men  from  whom  all  other  independent  and 
dependent  measures  had  already  been  collected.  Since  the 
same  rater  did  not  fill  out  every  form,  it  was  necessary  to 
calculate  2  scores  for  each  rater’s  ratings  so  that  all  of 
the  ratings  would  be  on  a  common  metric.  Therefore,  it  was 
the  2  score  ratings  and  not  the  raw  score  ratings  themselves 
that  were  submitted  to  analyses. 

All  dependent  measures  for  CHAPARRAL  and  VULCAN  were  to 
be  collected  by  personnel  at  the  Army  Research  Institute 
Field  Unit  at  Fort  Bliss.  Originally,  the  investigators 
requested  certain  specific  measures  from  the  set  of 
available  dependent  measures  and  certain  others  that  might 
actually  be  available.  These  measures  and  the  actual 
measures  that  were  collected  are  documented  in  the  next  two 
sections  of  this  report. 

CHAPARRAL  Measures.  Based  on  the  analysis  of  CHAPARRAL 
(16P)  AIT  training ,  certain  written  and  performance/pro¬ 
ficiency  test  scores  were  requested  for  each  trainee.  These 
were  to  be  collected  from  measures  that  were  known  to  exist 
in  current  AIT  training.  A  listing  of  these  tests,  noting 
which  ones  were  requested  by  the  investigators,  which  ones 
were  actually  collected,  and  which  were  submitted  to  the 
first  canonical  correlation  analysis  is  presented  in  Table 
28.  The  variable  names  used  for  computer  input  are  also 
listed  on  the  table  (if  applicable).  Some  other  measures 
were  requested  which  were  not  identified  positively  as  in 
existence,  but  which  some  AIT  instructors  indicated  did,  in 
fact,  exist.  These  were: 

•  A  final  written  test  score 

•  A  score  for  a  "hands-on”  driving  test 

•  A  score  for  a  "hands-on"  test  of  target 
engagement  and  employment. 

It  should  be  noted  that  as  different  phases  of  analysis 
progressed,  some  measures  that  were  collected  would  be 
dropped  from  the  analysis.  In  some  cases,  several  measures 
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were  aggregated  into  a  composite  which  was  then  submitted 
for  analysis.  Since  there  was  no  final  written  test  for 
CHAPARRAL  performance,  it  was  decided  to  create  a  written 
composite  which  consisted  of  the  sum  of  the  four  CHAPARRAL 
measures  shown  in  Table  28. 

VULCAN  Measures.  Based  on  the  analysis  of  VULCAN  (16R) 
AIT  training,  certain  written  and  performance/  proficiency 
test  scores  were  requested  for  each  trainee.  Some  of  these 
were  to  be  collected  from  measures  that  were  known  to  exist 
in  current  AIT  training.  A  summary  of  these  existing  VULCAN 
dependent  measures,  noting  which  ones  were  requested,  which 
ones  were  actually  collected,  and  which  ones  were  submitted 
to  the  first  canonical  correlation  analysis  is  presented  in 
Table  29.  The  variable  names  used  for  computer  input  are 
included  on  this  table,  if  applicable.  Since  both  written 
and  proficiency  tests  for  VULCAN  consisted  of  more  than  one 
content  area  per  test,  the  various  content  areas,  per  test, 
are  now  listed,  with  number  of  questions  per  content  area 
where  known.  These  are  presented  so  that  the  difficulties 
of  making  inferences  about  precise  areas  of  training 
difficulty  can  be  more  easily  understood.  First  is  the 
information  about  the  written  VULCAN  tests. 

Written  VULCAN  #1  (first  week  of  AIT — total  of  40 
questions ) : 

•  General  Subjects  (10  questions) 

•  Controls  &  Indicators  (10  questions) 

•  Operating  the  M163  SP  VULCAN  (15  questions) 

•  Chassis  Trouble-shooting  (5  questions) 

Written  VULCAN  42  (second  week--total  of  40  questions): 

•  Preventive  Maintenance  Checks  and  Services 
(PMCS)  (15  questions) 

•  Corrective  Action  (5  questions) 

•  Auxiliary  Power  Unit  (APU)  (5  questions) 

•  Daily  Armament  System  Checks  (10  questions) 

•  Mount  Trouble  Shooting  (5  questions) 

Written  VULCAN  #3  (third  week--total  of  20  questions): 

•  Ammunition  (5  questions) 

•  Sight  Current  Generator  (5  questions) 

•  Towed  VULCAN  (M167)  Emplacement  (3  questions) 

•  M167  Interrupter  (5  questions 

Written  VULCAN  #4  (fourth  week)--total  of  30 
questions ) : 

•  Boresighting  (10  questions) 

•  Changing  Radar  Frequency  (10  questions) 

•  Water  Crossing  Operations  (5  questions) 

•  M561  Gama  Goat  (5  questions) 
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TABI.K  29.  SUMMARY  OF  FX  1  ST  I  NO  DKI'FNDFNT  MKASURFS  FOR  VULCAN  (  1 6 R ) 
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Final  Proficiency  Test  -  Part 
Final  Proficiency  Test  -  Part 
VACR  Visual  Aircraft  Recoynition 


Written  VULCAN  #5  (fifth  week) — total  of  25  questions): 


•  Communications  (5  questions) 

•  M163  Ammmunition  Load  (10  questions) 

•  Ammunition  Storage  System  (5  questions) 

•  M167  Ammunition  Load  (5  questions) 

Final  Written  VULCAN  Test--100  questions  (included 
content  from  all  of  the  five  written  tests  outlined). 

The  following  describes  the  VULCAN  proficiency  tests. 

Proficiency  Test  #1 

•  APU 

•  PMCS  Checklist  # _ 

•  Daily  Armament  System  Check  # _ 

Proficiency  Test  #2 

•  Boresighting 

•  Changing  Radar  Frequency 

Proficiency  Test  #3 

•  Towed  Emplacement 

•  Fire  Interrupter 

Proficiency  Test  #4 

•  M163  Load 

•  M167  Load 

Final  Proficiency  Test 

•  ( to  be  determined) 

•  ( to  be  determined) 

•  (to  be  determined) 

A  count  of  the  various  proficiency  subtests  yields  12 
different  measures.  Because  of  the  vague  nature  of  each 
measure,  it  was  decided  that  (1)  none  of  the  three  subtests 
for  final  proficiency  would  be  utilized  in  the  data 
analysis,  and  (2)  the  remaining  nine  subtest  measures  would 
be  aggregated  into  one  proficiency  composite  measure.  This 
composite  would  be  based  on  the  total  number  of  "go’s" 
across  the  remaining  subtests.  Operationally,  this  meant 
that  the  highest  score  a  person  could  get  on  the  proficiency 
composite  measure  was  nine--one  "go”  for  each  subtest. 
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As  with  the  CHAPARRAL  dependent  measures,  some  measures 
requested  for  VULCAN  were  not  positively  identified  as 
existing,  although  there  were  indications  that  they  might 
have  existed.  These  measures  were: 

•  "Hands-on"  test  of  target  engagement  and  employment 

•  "Hands-on"  driving  test. 

No  measures  for  target  engagement  and  employment  or  for 
driving  were  made  available. 

Statistical  Analysis 

Before  any  other  analysis  was  undertaken,  a  count  was 
made  of  the  numbers  of  soldiers  who  possessed  the  various 
Aptitude  Profiles  that  had  been  identified  in  the  REDEYE 
sample.  This  was  done  separately  for  both  the  CHAPARRAL  and 
VULCAN  samples.  The  exact  same  criteria  for  membership  in 
each  Profile  Group  was  applied  here  as  was  applied  in  the 
REDEYE  study.  The  criteria  were  explained  in  Chapter  III 
and  will  not  be  repeated  here.  Because  of  the  large  number 
of  soldiers  in  the  C/V  samples  who  had  the  default  profile 
(i.e.,  they  could  not  be  categorized),  the  analysis 
progressed  according  to  the  pattern  that  occurred  for  the 
exploratory  REDEYE  analysis. 

The  data  collected  were  analyzed  using  factor  analyses 
and  canonical  correlation  analyses.  The  individual  aptitude 
measures  from  the  test  battery  were  submitted  to  the  factor 
analyses  in  order  to  investigate  the  underlying  structure  of 
abilities  in  the  C/'V  samples  and  to  compare  the  structure  of 
abilities  between  the  three  samples.  The  aptitude  measures 
collected  from  the  Army  (AFQT  and  ASVAB)  were  not  included 
in  the  factor  analyses  because  these  scores  were  not 
available  for  the  REDEYE  sample.  All  factor  analyses  for 
the  three  samples  could  then  be  based  on  essentially  the 
same  variables. 

Twenty-nine  independent  variables  were  submitted  to  the 
first  factor  analysis  for  each  sample  (i.e.,  C/V) .  The 
perceptual  speed  test  was  the  only  measure  in  the  C/V 
samples  that  had  not  been  in  the  REDEYE  analysis.  As  with 
the  REDEYE  analysis,  the  principal  component  solution 
(principal  factoring  without  iteration)  produced  an 
orthogonal  factor  matrix  which  was  rotated  by  the  varimax 
method.  The  number  of  factors  was  unrestricted  in  the  first 
analysis.  A  scree  analysis  was  performed  to  help  suggest 
how  to  restrict  the  number  of  factors  to  be  extracted. 
Separate  factor  analyses  were  performed,  using  the  same 
factoring  and  rotation  methods  on  the  same  variables  but 
restricting  the  number  of  factors  to  four,  five,  seven,  and 
eight  for  VULCAN  and  to  four,  five,  and  seven  for  CHAPARRAL. 
Simple  structure  analyses  were  then  performed  on  each 
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solution  in  order  to  determine  the  most  meaningful  one.  The 
final  solution  for  each  sample  was  interpreted  independently 
of  any  solution  for  the  other  sample  and  then  again  in  light 
of  the  solutions  for  the  other  two  samples. 

Again,  paralleling  what  transpired  in  the  REDEYE 
exploratory  analyses,  two  separate  canonical  correlation 
analyses  were  conducted  for  VULCAN  and  two  for  CHAPARRAL. 

The  first  included  all  twenty-nine  variables  from  the  factor 
analyses  for  the  first  set  in  the  canonical  analysis  with 
selected  variables  for  the  second  set  (dependent).  The 
dependent  measures  for  each  of  the  analyses  will  be 
explained  under  the  "Analysis"  section  of  this  chapter.  A 
second  canonical  correlation  analysis  was  performed  after 
the  one  just  outlined,  for  both  C/V.  In  each  case,  the 
second  canonical  analysis  was  based  on  the  first  one  and  was 
intended  to  take  into  consideration  the  masking  influence  of 
general  ability. 


Analysis  and  Results 


This  section  presents  a  descriptive  summary  of  the  raw 
score  data  including  the  distribution  of  the  CHAPARRAL  and 
VULCAN  samples  on  the  "original"  aptitude  profile 
categories.  The  results  of  the  factor  analyses  and 
canonical  correlation  analyses  are  also  summarized.  First 
will  be  a  discussion  on  the  aptitude  profiles.  After  that 
will  be  the  CHAPARRAL  analysis  and  results,  and  finally,  the 
VULCAN  analysis  and  results.  A  discussion  of  the  summaries, 
conclusions,  and  recommendations  for  future  research, 
sensitive  to  comparisons  between  results  from  all  three 
samples,  will  be  presented  in  the  last  chapter  of  this 
report . 

Aptitude  Profiles 

All  aptitude  test  measures  were  scored  for  both 
CHAPARRAL  and  VULCAN  soldiers.  Based  on  those  scores,  a 
count  was  taken  to  see  how  many  men  fit  the  original 
aptitude  profiles  that  had  been  identified  in  the  REDEYE 
studies.  A  summary  of  the  number  of  people  who  fit  each 
aptitude  profile  for  REDEYE,  CHAPARRAL,  and  VULCAN  samples 
is  presented  in  Table  30. 

One  of  the  purposes  of  the  C/V  analyses  was  to  see  if 
the  same  or  similar  aptitude  profiles  existed  in  the  C/V 
population  as  exist  in  the  REDEYE  sample.  The  data  of  Table 
30  helps  to  achieve  this  purpose.  The  table  shows  the  total 
number  of  soldiers  in  each  sample  (N) ,  the  number  of 
soldiers  with  each  profile  (n),  and  the  percentage  of  the 
total  N  for  a  particular  sample  who  had  each  profile.  A 
quick  look  at  the  totals  shows  that  the  patterns  in  the  C/V 
samples  are  not  the  same  as  were  found  in  the  REDEYE  group. 
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TABLE  30 


I 


I 


t 


The  differences  in  profile  distribution  suggest  that 
the  training  environment  itself  has  some  effect  on  the 
development  of  the  profile.  All  REDEYE,  CHAPARRAL,  and 
VULCAN  trainees  are  selected  from  the  same  population  and 
there  was  no  reason  to  expect  such  wide  variance  in  profile 
distribution.  It  should  be  noted  that  the  REDEYE  population 
had  been  in  the  task  for  about  a  year  and  that  the  other  two 
groups  had  not  yet  finished  training. 

It  is  quite  clear  that  the  frequency  of  Profile  3  is 
independent  of  the  task  and  represents  a  fairly  constant 
portion  of  the  population.  In  a  sense  then.  Profile  3  could 
be  said  to  be  generalizable .  Profiles  1  and  2  disperse  very 
differently  for  CHAPARRAL  than  they  do  for  either  REDEYE  or 
VULCAN  and  Profile  1  loses  significance  for  VULCAN.  This 
has  more  meaning  when  one  compares  the  results  of  all 
REDEYE,  CHAPARRAL,  and  VULCAN  analyses  (see  Chapter  V).  The 
components  which  contribute  to  Profile  1,  Spatial-analytic, 
are  the  least  important  in  predicting  VULCAN  training 
performance . 


CHAPARRAL 

Analysis .  All  analyses  were  conducted  on  the  subfile 
of  cases  for  whom  there  were  ratings,  as  well  as  all  other 
dependent  measures  and  measures  from  the  aptitude- test 
battery.  The  ratings  were  described  earlier  in  this 
manuscript.  It  had  been  expected  that  the  ratings  made  by 
drill  instructors  for  different  aspects  of  performance  might 
provide  more  accurate  dependent  measures  than  some  of  the 
measures  collected  by  the  Army.  However,  the  rating  scales 
themselves  appeared  to  have  little  variance  between  scales. 
Therefore,  the  overall  rating  scale  (ZR6)  was  used  in  lieu 
of  any  of  the  others. 

Just  as  with  the  REDEYE  analysis,  the  number  of  cases 
(67)  in  this  analysis  is  small.  The  results  of  the 
CHAPARRAL  analysis  should  be  considered  tentative  and 
exploratory  in  nature.  However,  if  the  analyses  of 
CHAPARRAL  data,  REDEYE  data,  and  VULCAN  data  each 
independently  point  toward  a  similar  direction,  then  the 
small  sample  sizes  will  not  be  as  limiting  as  if  there  had 
been  only  one  small  sample  to  begin  with.  If  any  similar 
patterns  exist  in  the  three  small  samples,  it  would  provide 
support  for  the  patterns  that  would  otherwise  have  to  come 
from  a  larger  sample. 


The  tests  for  the  aptitude- test  battery  were  scored  for 
all  soldiers.  The  rating  scales  were  scored  too.  The 
measures  for  ratings  were  standardized  by  rater  so  that  all 
ratings  would  be  on  a  common  metric.  Performance  and 
written  test  scores  were  collected  by  the  Army.  A  summary 
of  the  means,  standard  deviations,  and  number  of  cases  on 
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which  each  measure  was  based  is  presented  in  Table  31.  No 
summary  is  included  in  this  table  for  the  ratings  because 
for  all  of  them,  the  mean  was  0  and  the  standard  deviation 
1.  Refer  back  to  Tables  27-29  for  descriptions  of  each 
measure . 

A  series  of  factor  analyses  was  conducted  according  to 
the  same  procedures  outlined  for  the  REDEYE  exploratory 
analysis.  These  were  done  in  order  to  investigate  the 
underlying  structure  of  the  aptitude  variables  in  this 
sample  population.  All  measures  in  the  aptitude  test 
battery  with  the  exception  of  the  Total  Thurstone  were 
submitted  to  ‘analysis.  The  correlation  matrix  upon  which 
the  factor  analyses  were  based  is  presented  in  Appendix  D. 

The  number  of  factors  was  unrestricted  in  the  first 
factor  analysis.  A  summary  of  the  eigenvalues,  percent  of 
variance  explained,  and  cumulative  percent  of  variance  for 
both  significant  and  nonsignificant  factors  is  presented  in 
Table  32.  The  factor  matrix,  before  rotation  by  the  varimax 
method  is  presented  in  Table  33.  It  yielded  nine  factors 
with  an  eigenvalue  greater  than  one.  Also  in  Table  33  is 
the  rotated  factor  matrix,  followed  by  the  transformation 
matrix.  Recall  that  the  latter  indicates  the  correlations 
between  factors.  A  scree  analysis  suggested  that  the  number 
of  factors  should  be  restricted. 

Separate  factor  analyses  were  conducted  restricting  the 
number  of  factors  to  four,  five,  and  seven.  Simple 
structure  analyses  were  performed  on  each  varimax  rotated 
factor  matrix.  The  results  of  these  analyses,  coupled  with 
the  simple  structure  analyses  that  were  made  concurrently 
for  REDEYE  and  VULCAN  data,  indicated  that  the  matrix 
restricted  to  seven  factors  would  provide  the  most 
meaningful  solution  and  the  one  that  could  be  compared  most 
easily  with  the  other  solutions  for  the  other  samples.  This 
solution  adhered  to  the  five  principles  of  simple  structure 
already  mentioned  earlier  in  this  report.  Both  the 
unrotated  and  the  rotated  matrices  for  the  seven  factor 
solution  are  presented  in  Table  34,  along  with  the 
transformation  matrix  for  the  factors. 

The  same  criteria  for  interpretation  of  loadings  was 
applied  to  the  CHAPARRAL  data  as  was  applied  to  the  REDEYE 
data.  Positive  or  negative  loadings  of  .5  or  greater  were 
considered  high  loadings,  those  between  .2  and  .5  were 
considered  substantial  loadings,  and  those  with  less  than  .2 
were  considered  as  zero  or  near  zero  loadings. 

For  easier  interpretation  of  the  factors,  a  hier¬ 
archical  listing  of  variables  that  load  on  each  factor  is 
presented  in  Table  35.  In  order  to  save  space,  only  the 
loadings  of  +  .30  or  greater  are  shown  on  the  table.  If 
there  were  other  loadings  between  .2  and  .3,  a  note  to  that 
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TABLE  31 


SUMMARY  OF  MEANS  AND  STANDARD  DEVIATIONS  FOR 
CHAPARRAL  INDEPENDENT  AND  DEPENDENT  VARIABLES 


VAP I • . 

L  A8  PI  S  .  . 

Mr  AM 

STANDARD  OF  V 

CASES 

V? 

kop-p 

6  0. 822  4 

16  .6636 

67 

V3 

COL  CP 

60. 47  76 

13.2520 

67 

V4 

\A  I  NTC 

8 1 .2000 

12.4403 

67 

V5 

CLf-  LEX 

3  1. 56  72 

23  .8SS7 

67 

V6 

CLSPO 

8. 372  1 

5.3480 

67 

V  7 

l  TH 

1 7.4328 

10.0321 

67 

Vfi 

OTH 

14.6716 

7.5986 

67 

VI  0 

GEPT 

5 . 3?  09 

5.3397 

67 

V  1  1 

’’UESUI  T 

1 6.6269 

7.0S14 

67 

V  1  2 

S  T  A  TC 

43. B6S7 

1 1 .3909 

67 

V  l  3 

T  9  4  I  T 

41 .8507 

10.3766 

67 

V  1  4 

.'01 

10.7015 

6  .4244 

67 

V  I  5 

PA 

6.5373 

2.2247 

67 

VI  r. 

F9 

3.4030 

1 .5380 

67 

V  1  7 

F  C 

t . 5075 

2 .6307 

67 

VIA 

FF 

5. 8055 

1 . 9628 

67 

VI  9 

FT 

6.67lo 

2.0029 

67 

v?o 

F  G 

7. 71 64 

2.2751 

67 

V2  1 

F  H 

6.1194 

2.3128 

67 

V22 

P  I 

5.0746 

1 .8448 

67 

V?  3 

ri. 

6. 7010 

1 .8385 

67 

V  24 

FM 

5. 2388 

1 . 7502 

67 

V25 

FN 

6.0448 

1  .6826 

67 

V26 

FO 

6.1791 

2.36  72 

67 

V  2  7 

C  t 

6.5373 

1 .9332 

67 

V28 

G  2 

5.3433 

1  .8303 

67 

V29 

Q3 

6  .  86  5  7 

2. 06o3 

67 

V30 

04 

5.5224 

2 . 1345 

67 

V40 

GZn  S 

32.1402 

l 1 .3033 

67 

»Cl 

MAP* 

8.5970 

1.3933 

67 

wc? 

cnwMu* 

90.0000 

1 0.9751 

67 

WC3 

M730V* 

9?. 0  I  40 

7.3885 

67 

«C4 

GENSUF1V* 

86. 1791 

1 0.5067 

67 

»C5 

FOC  CHAP 

e6.64 1 8 

1 1 .9464 

67 

PC  1 

2e 

9.1343 

0.8509 

6  7 

PC2 

2E 

9. 0P96 

0.9000 

67 

PC3 

38 

V.  1  194 

0.7076 

67 
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TABLE  32 


SUMMARY  STATISTICS  FOR  ALL  FACTORS  IN  UNROTATED 
FACTOR  ANALYSIS  OF  67  CHAPARRAL  CASES 


VARIABLE 

VALUE  USED 

IN  DIAGONAL 

FACTOR 

V2 

1.00000 

1 

V3 

1.00000 

2 

V4 

1.00000 

3 

V  5 

1.00000 

4 

V6 

1.00000 

5 

V7 

1.00000 

6 

V8 

1.00000 

7 

V10 

1.00000 

8 

Vll 

1.00000 

9 

V12 

1.00000 

10 

V 13 

1.00000 

11 

V14 

1 . 00000 

12 

V15 

1.00000 

13 

V16 

1.00000 

14 

VI 7 

1.00000 

15 

V18 

1.00000 

16 

VI 9 

1 . 00000 

17 

V  20 

1 . 00000 

18 

V21 

1.00000 

19 

V22 

1.00000 

20 

V  23 

1.00000 

21 

V24 

1.00000 

22 

V25 

1.00000 

23 

V26 

1.00000 

24 

V27 

1.00000 

25 

V28 

1.00000 

26 

V  29 

1.00000 

27 

V30 

1.00000 

28 

V40 

1.00000 

29 

EIGENVALUE 

PCT  OF  VAR 

CUM  PCT 

5.40950 

18.7 

18.7 

3.32790 

11.5 

30.1 

2.43786 

8.4 

38.5 

1.82425 

6.3 

44.8’ 

1.65370 

5.  7 

50.5 

1.49648 

5.2 

55.7 

1.43688 

5.0 

60.6 

1.33528 

4.6 

65.2 

1.21469 

4.2 

69.4 

0.99857 

3.4 

72.9 

0.95672 

3.3 

76.2 

0.87958 

3.0 

79.2 

0.77381 

2.7 

81.9 

0.70  291 

2.4 

84.3 

0.63342 

2.2 

86.5 

0.55705 

1.9 

88.4 

0.52616 

1.8 

90.2 

0.45639 

1.6 

91.8 

0.42578 

1.5 

93.3 

0.34496 

1.2 

94.5 

0.29929 

1.0 

95.5 

0.28205 

1.0 

96.5 

0.25450 

0.9 

97.3 

0.21429 

0.7 

98.1 

0.17378 

0.6 

98.7 

0.13480 

0.5 

99.1 

0.10958 

0.4 

99.5 

0.08656 

0.3 

99.8 

0.05328 

0.2 

100.0 
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TABLE  33 


FACTOR  MATRICES  (UNRESTRICTED)  FOR 
CHAPARRAL  DATA  (N=67) 


I  AC  T  Q  0  «tutl  USING  .  ■«  I  NC  1  •’  A*.  r  ACTl-M.  NO  I  HO»T  [D*ti 


V? 
V  J 
va 
vs 


'•CTO*  I  FACTO*  2  FACTO*  .1  FACTO*  *  FACTO*  5 

0.M92*  -0.01*16  9,«IT«1  -0.003*7  -0.0*040 

0.69609  0.1ft"0!  O.MIO)  0.1479  1  -0.09197 

0.43919  a. onto*  a.4479*  0.077*0  -0.04722 

n. jirj?  0.4.-S14  0.077*2  -0.30097  o.o?*»i 

0. *21  JO  0.270*?  -0.  07)40  -0.1493*  -0.0*415 

0.444*3  6.«4IM  -0.12*14  0.32470  -0.27200 

0.51914  0.41742  -*.11*63  0.73050  -0.03139 

0.340*5  0.4430*  -0.245*3  -0.34044  0.70004 

0.4*911  0.27044  0.12300  0.3332*  *.23027 

-0.07007  0.4099*  0.11272  0.73*10  -0.14012 

-0.6«*17  0.40105  0.103*7  0.71  173  0.05397 

0.)«419  -0.02001  -0.342*1  0.10*11  0.34200 

-0.0490*  -0.40237  0.27977  0.14900  0.33240 

0.337*7  0. »oOOi  -0.44720  O.IttIO  -0.22240 

0,47  743  -  0  .  3  7  04*  -0.04779  -0.27797  0.0400) 

-O.  3*0/7  0.299N4  -9. ’07*5  -0.50400  <J.2M«| 

0.20572  -0.03 1  3#  -0.21200  -0.l37(|  -0.2|04« 

a.11044  -0.31497  -0.37479  0.4*743  0.0^470 

o,  ?S*37  -0.39044  0.777*7  -0.17239  -0.1/093 

-0.05044  -0.03747  0.7*142  0.27704  -0.37200 

-0.119(7  0.40093  -0.10130  0.1313®  -0.0*004 

0.14*97  0. 01910  0.15*47  -0.0*643  0.«|®7) 

-0,10424  0.030**  0.39371  0.29770  0.2*191 

-0.4907®  0,)7**l  -0.00*44  0.07010  0.302*4 

9.07447  0.13094  0.00944  *.14907  0.4234* 

9,014*7  0. 37410  0.40472  -0.23491  -0. )0«4* 

9.49376  -  0. 3*004  -0.79949  0.7*030  9.0|439 

-0,43127  0.4)743  O.»»,*07  0.04403  O.Q/0O* 

0  .  532  *  4  0.32  2  7  7  0.3  3  70*  -0.02  30  7  0.*99lt 


4  4  C  TO®  *  FACTO*  F  F  4C  TO*  •  F  4C  TO*  9  C  UP«lF*A(.  |  T  y 

0.003*2  e.OlFO*  *.00032  -9.2212®  0.73740 

-0.303*9  0.03743  -*.07429  0.204**  0.01*47 

-0.1*767  0.09*9*  -0.2921*  0.16/29  0 . /* 4 36 

0.37)34  0.09506  -6.371 7J  O.IOFlO  0.6*74* 

0.09239  0.0410*  -0.02493  -0.0*670  0.9*330 

0.102*1  -0.02917  *.2*213  -0.07419  0.67444 

0.1617*  -0.094*9  0.15047  0.0201*  0.74172 

*. 11*2*  •«. 04*02  -0.13142  0. OF  1 20  0.///I3 

-0.12315  -0.04342  -0.04020  *.03614  0.90647 

0.23241  *.0446*  -0.29*57  -*.17297  O.fttlft* 

0.7142*  -0.12441  -0.227*7  -0.017*2  0.03*96 

0.13179  — *• I  I *6 ▼  0.3493®  0.43431  0.7T|)6 

0.42024  -0.00044  0.07221  -*. 11199  o.fcV' 10 

0.02®04  -0.00040  0.0*391  -0.0*072  0. •>«**/ 

-0.2620*  -0.1*263  0.02*33  3. 09934  0.*c/4| 

-0.13640  0.2794*  0.17*4?  8. 1*331 

0.  *7  37  2  0.99160  -*.0*924  0.2700)  0./.*6*4 

•0.104**  0.09*3*  -0.163*7  0.01*9?  0.6)<«< 

0.  *  1*6  4  0.201  79  0.33734  -0.2*31*  8.zzi«'i 

0.0«|Z|  0 . *  I  0*9  0.02672  0.37969  9. 6/1*1 

—  0.  *®  1 00  0.3230*  •  0.07193  -0.2*0** 

-0.1*61*  0.57401  -0.24416  -0.03144  0.6*«®3 

0.097*7  0.0*14*  0.3*714  0.34774  8 . 4*  f  |  7 

-0.0773*  -0.01497  -0.19960  0.17321  0.4AVH/ 

-0.00069  0.44*41  0.33430  -0.45394  3.  /*-*.•,» 

-0.27203  -0.II/I9  0.219**  -0.06040  b.oOA/O 

0.3*09®  0.044*4  -0.42420  -O.lJO'l 

0.071*6  -0 • 09070  0.05401  0.12060  o.  *•«-•* 

0.  1*107  -9.2*079  -0.10415  -0.21  06  7  O.F'.f/o 
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-0.21 749 
-0 , 2**4* 
-0. 1*6*9 
0. | 0906 
-0.263/1 
0. 1 099* 
-0.0099* 
-0.206*7 
-4.01*5® 
4, *4*32 
.{.IM36F 
-0.32734 
0.04*14 
-3.  1  0J?6 
*0.7623*4 

0 • 02*2  i 

-O. I  31*0 
-0.0*7*? 
-0.3167* 

0. 19375 
O.  1  0  7*7 
-0.0'*** 
o. i6?:9 

0.0*34* 

0. 0*3*9 
-0.2*074 

*.  9*1*04 

0.09*73 


«.  533*6. 
-0. 1*4*1 
-0.17279 
-0.066/1 
-0.00*64 
-<1.036  1? 

0.  14649 
-0.4 40** 
-0. » 3®o? 
0.0?3*? 
0.01 l 3* 
0.  2757* 
-0. 0»*»*4 
0.7560A 
0.  I®t  72 
-0.2320? 

-  0. 00**  7 
0.76346 
0.2?47| 
0. *3 ’0  3 
0. 939*0. 


0.090*3 
0.1*94* 
0.00?  <  ? 
0.  I  *71  3 
<3.**  194 
«.****» 
0.  7*90*. 
0.3*964 
0 . 2**  1  2 
0.01 710 
-0.13936 
0.31 130 
-0. J60*J 
9.69094 « 
-0. 1 *•• I 
-O. 1*622 
0.I2«*S 
0.09*  70 
0.07*1® 
-O. 06*39 
0.26312 
-0 • 30*03 
-0. 11924 
-O. 13421 
0.19130 
0. I  1 ??? 
0.07194 
-0.  12  I  ?• 
0.1*360 


0 . 07  t  12 
0. 3401 3 
O.  /*»*» 

0. r»)OOa 

0.36630 
«.«’*! 
0.230*1 
4.  71  294  # 
0.07544 
-0.06101 
-0.07  700 
O. 135*  3 
-0.07439 
0. 109*2 
0.02253 
0.26332 
0.  39071 
-O.  2961  5 
-0.0097* 
-0.21*10 
-0.2*007 
0. 76  760 
-O. 2407* 
O. I  I  763 
-0.0*909 
-0.  06776 
0.04*4* 
-0.00672 
0.9«3t  I 


-0.1  5*43 
-0.03*0* 
o.  OO I  #3 
-0. 122*7 
-0. 0*401 
-0.0  7**9 
0.090*7 
-0.02276 
0.  I  7429 
-0.0123  7 
-0.0912* 
0. 221*9 
0. 23*62 
0.  1 006  F 
0. 0963 1 

-  0.  wo** 

0. I  7439 
0.  71  29®, 
-0. 1 1220 
-0. *63*7 
-6. 1 1*43 
0. 1*201 
-9. I *9* 2 
•0.  01  300 
0.01 310 
-0.6***l 
*• 71*24 
-*. 3**94 
•  0.041*3 


0.34*02 
-0.1 !*•• 
-D. 01 *J  » 
0,04*47 

0.07062 
8.07100 
•0.3ft* I  * 
-O. 1694* 
-*. 09260 
-9.  0442* 
-0. 0030? 
-O. 3t 1 2% 
0.0397* 
-0. I960? 

0.034*0 
-0.  J6060 
0. I  35** 
-0. 1 1*67 
*• 7029® 
0.0*21 3 
..4.4*94® 
-0. 19*13 
0.3*®6* 
-0.3709? 

0. 1 729* 
-0. 10770 
O. 0*13* 
-O. 90*97 
0.233®® 


0.09930 
-0.02261 
-*•00632 
-0.0729) 
0.00939 
0. 010*9 
*.01031 
0.00060 
0. 1*321 
-0.0211  I 
-O. I0?74 
-0.33190 
0.0«9?0 
0.013*2 
-*.  1 »*93 
0. 3391  7 
0.07*40 
0.03399 
*.12973 
-0.0617* 
0.4  37*4 
*.9*00*. 
0.09979* 
0. 0621 0 
*. *2*9*1 
-*•09460 
-0.02372 
-0.003*0 
*. 19669 


-0.03*93 
0.111*6 
0.14*2* 
0.0*196 
-0.90234 
0. 06*45 
-0.0  70*4 
-0.15090 
-0. 16466 
0.0661 6 
-0.0*907 
-0.03702 
-0.1 1033 
0.00*92 
-0. 13733 
0.09603 
«•  *•  3*9 
0.0*206 
0.22406 
«.*••• 1 
0.016*7 
*. i4  r*6 
O. 1*13? 

-*.  10974 
-0.0366* 
-0.0049* 
-0.00371 

H.««W 


I  3*** 

0.092*6 
0.00441 
-0.  0937? 
-0.1102* 
•  •  *  7  *  O® 
0. 1*070 
0.06046 
0.23962 
-0.2341* 
-0.0046* 
*.7*3*9 
0.23090 
-0. 1021 « 
0.01*13 
0.12606 
-0.0271* 
0.06594 
-*. 10*6? 
0. 1001* 
-0.224*6 
-0.004*4 
*•*23*2 
0. 19961 
0.  0*1  34 
-0. 103*4 
-O. 1*65* 
0. 1741 2 
*.191*7 


06MAM0M  aiiau 


F  4C  7  0®  I  FACTO*  ?  F4CT06  3  FACTO*  A 

F  AC  TOW  I  -0.9*999  0.4*201  0.422*1  9. 3*33* 

F  4C  T  n#  2  9.4160*  0.12*76  0.43342  0.336*3 

FACT)*  1  0.25061  0.646*4  -0.474*3  -0.1016* 

FACTUM  4  0.3467®  0.  ?■*<•«  0.2*7??  -0.96440 

F4CTHH  ®  0.0466*  -0.0214?  -O.J2445  0.7*921 

r*C»5®  *  0.326*4  -0.2404?  0.167*7  0.429*3 

F4C  TO*  7  -3,00*67  -0.01223  -0.07611  0.06046 

TACT  31/  0  -9.7671  1  -0.76417  0.17902  -0.4*44® 

?  AC  TO*  9  -0.00666  0.04D3  -0.1460*  0.17239 


FAC  TO*  4  FACTO*  9  FACTO*  7  FACTO*  •  FAC To*  • 

0,1*97*  0.14*17  *.*42*4  -*.*2110  0.04*3® 

-*, 3*3*4  -O. 3799*  0.14)33  -0.0040*  0.0272* 

-0,44190  0.13*77  0.0I22*  0.04393  0.03723 

0,91*01  0.01020  0.02743  0.03*36  *.2974* 

0,714**  -0.02*71  *.4*?94  -*.4*6?7  *.9344| 

0,16024  0.72219  -9.197*7  *. 1*69®  *.12797 

0,06®**  -0.09*34  *.69439  0.0*600  -0.10*4® 

-*,50219  0.27373  0.714*1  0.0*403  0.46?«? 

-0,01*0®  -0.340*9  -9.43919  9.479**  *.*3*4) 
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TABLE  34 

FACTOR  MATRICES  (RESTRICTED  TO  SEVEN  FACTORS) 
FOR  CHAPARRAL  DATA  (N=67) 


FACTOM  MATAIA  USING  PfUMCIPAc  FACTOM,  NO  I  T  B4  AT  IONS 


►ACTOR  1 

FACTOR  2 

FACTOR  3 

factor  A 

FACTUM  5 

FACTOR  6 

FACTOR  7 

COMMA*  AL  17V 

V  2 

0.01929 

-0.01916 

0.91  74  3 

-0.00347 

0*00342 

0*01769 

0.6394  3 

V3 

0.09909 

9*10991 

0*39299 

0. 14203 

-0.06197 

-6.30999 

0.03733 

0.  7694  3 

V* 

0.63919 

0.06109 

0.4679  6 

0.07269 

-0.04222 

-0*14767 

0*09999 

0.67290 

V  3 

0.31  732 

0.42939 

0.07792 

Ml  .39092 

0*02961 

0*37139 

0*03304 

0.3722  0 

Vo 

0.62  130 

0.27662 

-0  .0  7  36  0 

-0.14V66 

-0.06419 

0*09239 

0.04164 

0.30  4  9  6 

V  7 

0.4*093 

0.99131 

-0.1261 4 

0.326/9 

-Ci. 27299 

0*16261 

-0*02617 

0.7392  V 

Vfe 

0.61916 

0.91  762 

-0.31963 

0.23090 

-0.03139 

0.161 76 

-0.09409 

0.  72966 

V  10 

0.69066 

0.46309 

-0.2699  3 

-0.34094 

0.20694 

0.1 1426 

-0.04902 

0.73  32  3 

V  1  1 

0.4991  1 

0*22644 

0*12306 

0.33049 

0.29627 

-0*12313 

-0*04332 

0.90  100 

V  12 

•0.62607 

0.40990 

0*1  127  2 

0.2991b 

-0 .1 60  12 

0*23241 

0*04466 

0.7209  7 

v  ii 

-0  .6943  7 

0.40  109 

0*1634  7 

0.21  123 

0.09J&2 

0.21426 

— O  .12  99 1 

0.7969  3 

V  14 

0.3tt439 

-0.0 <  66  * 

-0.3926  1 

0.1641 1 

0.39290 

0.&31 76 

-0.11667 

0.4532  9 

v  16 

-0.06994 

-0.90232 

0.2  797  7 

0. 14960 

0*33246 

0*42024 

-0.06044 

0.64  73  3 

V  16 

0.39242 

0.36603 

-0.49729 

0.  1  1  110 

-0.22296 

0*02604 

-0.00040 

0.  32  993 

V  17 

0  .46  74  3 

-0  .92  64  I 

•0  2)149 

-0.277*7 

0.04001 

-0.26406 

-0.19263 

0.6969  4 

V  Id 

-0.39  092 

0.29994 

-0.20279 

-0.90600 

0.2  7311 

-0*13640 

0  .27*59 

0.  70  33  / 

V  IV 

0.20932 

-0.09106 

-0.2  120  0 

-0.1971 1 

-0.2 1046 

0*42372 

0*33160 

0 . 64  24  9 

V  CO 

0.1 1946 

-0.31602 

-0  .3  742  0 

0.96793 

0.06970 

-6.  10944 

0.09039 

0.6000  ) 

v  21 

0  .29o32 

-0.399*4 

0  .2  3  26  T 

-0. 17239 

-0.17893 

0.43663 

0.20176 

0.5905  4 

V22 

-0.09994 

-0.03292 

0.36192 

0.27709 

-0.37260 

0*06171 

0.41099 

0.32  6  3  6 

V  23 

-0.11967 

0.40093 

-0.1  9130 

0.13199 

-0.0  9064 

-0*40100 

0.32309 

0.  36096 

V*4 

0. 1469  7 

0.0 1 910 

0.1  9642 

-0.09693 

0.41973 

-0.16616 

0.37363 

O.30O7  1 

V.5 

-0. 10424 

0.03669 

0.39JT  1 

0.29770 

0.26191 

0.00767 

0.04140 

0.  3263  7 

V  26 

— O  .496  79 

0.37931 

-0.0666  6 

0.07016 

0.30264 

-0.02236 

-0.01397 

0.4944  o 

V  2  7 

0  .0799  7 

O. 13099 

0.0  0  96  9 

0*  19V67 

0.42349 

-0.00663 

0.43E4I 

0.4390  7 

V2« 

0.01547 

0.39410 

0.40472 

-0.23931 

-0.30946 

-0.27263 

-0.11715 

0.33 16  7 

V  rt 

0  .  49  376 

-0.36099 

-0.2994  V 

0 .2  6c30 

0*0  1439 

0.0*696 

0.03564 

0.4911  3 

v  ju 

-0.43127 

0.41 363 

0.3620  7 

0.04903 

0  *0  7606 

0.07166 

-0.03026 

0. 51 97  J 

V  40 

0.93244 

0.32277 

0.33706 

-0*02307 

0*49611 

0.16107 

-0.26079 

0.90666 

V4MIM44  ROTATED  FACTOR  MATRIX 

FACTO*  1 

FACTOR  2 

FACTOR  3 

FACTOR  4 

FACTOR  3 

FACTOR  6 

FACTOR  7 

V  A* 

0.U027 

-0.21 732 

0.7  2  56  9 

-0.14079 

0.16414 

0*13:71 

0*02*16 

V  J 

0.17000 

-0.23289 

0.90/44 

-0.00209 

-0.14197 

-0.00435 

0.06260 

V  • 

0.13969 

-0.19323 

0.76809 

-0.09J6S 

0.01033 

0.061 76 

0*12636 

v  3 

0.94  J71 

0.00979 

0.0  725  4 

-9.43*90 

0*16723 

0*13132 

0*10093 

V  6 

0. 90123 

M).27e63 

0.2972  1 

-0.12364 

-0*064*3 

0.09770 

0*03733 

V  7 

0.70179 

0.2 1093 

0.31492 

0*13103 

-0*16042 

0.14313 

-0*16399 

V* 

0 .90073 

0.04612 

0.1  7404 

0.16*13 

-9*1*139 

-0*03321 

-0*06976 

V  10 

0*74  790 

-6.2o<X>9 

0.02676 

-0.25432 

0.002*8 

-9. 15262 

0.19416 

V  1  1 

0*31212 

0*00314 

0.3030  1 

0*22023 

-0.00309 

-9*24313 

0*20715 

V  12 

-0.06663 

0. 79356 

-9.20032 

-9.0*665 

-0 .1095  7 

0*11719 

-9*11463 

V  13 

-0.12  790 

0.92323 

-9.21926 

-0.  1J063 

0.02375 

-9*12906 

-9*09467 

V  14 

0.40499 

M>.  2  1  329 

-0.0342  7 

0.33636 

0.20127 

-0*23029 

0*13043 

V  13 

Ml .  2936  1 

0.  03692 

0.03136 

0.20634 

9.71003 

0*03142 

0*09695 

V  16 

0.61633 

-0*07597 

-9  .0  2370 

0.1  7003 

*0.30670 

0.07269 

-0.12396 

V  1  7 

-0*11212 

Ml*  1  7992 

0*1441 2 

0.0 J730 

0*12434 

-0*1*33* 

Ml  .09929 

V  19 

-0.00232 

0.0o044 

-9*4992  1 

-0.44743 

-0*24930 

-9*10336 

0.42144 

V  IV 

0.29135 

-0.15072 

-9.17343 

0*01239 

0*07791 

9*67963 

0.20496 

V  20 

-0.02604 

-0.  11422 

-9.02169 

0*73966 

-0*06333 

-0*00614 

0*04190 

V  21 

-0.0396* 

-0.26  749 

0*14740 

-9.0*443 

0.46266 

0*  3262b 

-9.02492 

V  22 

-9.21994 

0.26713 

0*3101  7 

0*07339 

-0*09967 

9*36331 

0*01123 

V  23 

0.04  766 

0.13264 

-0.0110  0 

0*0*009 

-0*70693 

-9*03336 

0*22979 

v  2* 

-9.07903 

-9*10136 

0*1  490  4 

-0*03639 

-0*03363 

0*06230 

0*73270 

V  23 

•9.20207 

0*3J/7f 

0*2637  9 

0*06203 

0*16110 

-9*12063 

0*20693 

v  26 

-0.01304 

9.49639 

-0.3159  7 

-9.07376 

-0*12240 

-9*29770 

0.19676 

V  27 

0.07992 

0*1 1791 

0*0  6  20  3 

0*13103 

-0*01370 

0.02633 

9.62469 

via 

-9*01943 

0* 1 1 662 

0.34937 

-0*33103 

-0*30334 

-0*03807 

-9.19377 

v.v 

0*14  763 

*9.36217 

0.12469 

9*32994 

0*12133 

0*1  OV  76 

0*00931 

V  jO 

-9.11493 

0*62279 

0.0463  1 

-0*31391 

-0*00462 

-0*11603 

0*03962 

V  40 

0*43799 

0*01273 

0*6 931  0 

-0*10363 

0*36742 

-9*37490 

0*21396 

TMAMSFORMATtOl  MATRIX 

FACTOR  1 

FACTOR  k 

FACTOR  3 

FACTOM  4 

FACTOR  9 

FACTOM  6 

FACTOR  7 

FACTOR  1 

0*36136 

MU30646 

0.66270 

0*11633 

0.10166 

0.060 74 

0.07202 

Factor  2 

0.61 140 

0.34 6e2 

0*0999  1 

-0*33970 

-0.36035 

Ml. 16164 

0*10369 

FACTOR  3 

-O.A*  169 

0.26442 

0*49763 

-0*41016 

0*2  02  *6 

0*04937 

FACTO*  * 

-0.01  742 

0.4  394  f 

0*3193  1 

<1*6244  1 

-0.06*34 

-0.03020 

^0*03966 

FACTOR  3 

0  .01  379 

0.02220 

-9*09996 

0.06334 

0  •  jO  1 33 

-0.69141 

0  .6*769 

F  ACTOR  6 

0.36982 

9.29  173 

-0.2239  6 

-0.00123 

0.73345 

0.421 13 

-9*09370 

FACTOR  7 

-9*06497 

0.01  J61 

-9.02739 

0.03332 

-0.26162 

0.66174 

0.69439 

t 


96 


t 


97 


effect  is  presented.  This  table  is  formatted  exactly  like 
Table  23  from  the  exploratory  analysis  of  REDEYE  data.  If 
there  is  any  difficulty  understanding  any  of  the  variable 
names,  refer  back  to  Table  27  for  clarification.  If  there 
is  any  difficulty  in  interpreting  the  table  itself,  refer 
back  to  the  earlier  discussion  of  Table  23  for  assistance 
(Chapter  III). 

A  description  and  discussion  of  each  of  the  seven 
factors  will  now  be  presented.  Tentative  names  for  six  of 
the  factors  will  also  be  given.  Any  comparisons  between 
these  and  the  factors  identified  in  the  REDEYE  exploratory 
analysis  will  be  reserved  until  later  in  this  report. 

Factor  1  can  be  called  the  "analytic"  factor.  The  only 
variable  which  cleanly  loads  on  this  and  only  this  factor 
is  the  quantitative  portion  of  the  Thurstone  Test  of  Mental 
Alertness.  Therefore,  it  is  the  only  factorially  "pure" 
measure  on  this  factor. 

It  would  be  inappropriate  though  to  label  the  factor  as 
quantitative,  because  of  the  analytic  nature  of  that  measure 
itself,  and  because  of  the  high  positive  and  almost  clean 
loadings  for  the  GEFT  (V10)  and  Closure  Flexibility  (V5) 
measures.  These  two  measures  clearly  tap  analytic  ability. 
For  both  measures,  the  loading  on  Factor  1  is  not  only  high 
and  positive,  but  for  each,  it  is  the  only  positive  loading 
on  any  factor  in  the  solution. 

It  could  be  argued  that  this  factor  is  a  general 
ability  factor  because  of  the  high  loadings  for  both  scales 
of  the  Thurstone  test  and  because  of  the  almost  factorially 
"pure"  nature  of  V16  (FB),  the  "Less  intelligent/More 
intelligent"  measure  from  the  16PF.  It  is  true  that  there 
is  confounding  with  general  ability  in  this  factor. 
Nevertheless,  if  all  loadings  are  taken  into  consideration, 
there  is  more  of  an  "analytic"  character  to  the  factor  than 
there  is  a  general  character.  The  alternating  question 
types  on  the  language  Thurstone  require  analytic  ability  to 
be  able  to  understand  just  what  to  do.  Other  measures  which 
have  high  or  appreciable  loadings  on  the  factor  and  which 
require  some  analytic  ability  are  V6  (Closure  Speed)  and  V40 
(Perceptual  Speed).  All  in  all,  the  best  name  for  the 
factor  remains  "analytical."  Other  measures  with  loadings 
between  .2  and  .4  on  this  factor  were  for  Two  Dimensional 
Perception,  the  Pursuit  Test,  the  "reserved"  dimension  of 
V15,  the  "happy-go-lucky"  dimension  of  V19,  the 
"tough-minded"  dimension  of  V22  and  the  "forthright" 
dimension  of  V25. 

Factor  2  is  clearly  an  "anxiety"  factor.  Trait  and 
state  anxiety  load  highest  and  are  almost  factorially 
"pure."  These  are  the  two  highest  loadings  of  the  entire 
factor  analysis.  In  addition,  the  loadings  are  the  only 
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positive  loadings  for  V12  and  V13.  Each  one  also  loads 
negatively  between  .2  and  .3  on  the  third  factor,  but  not  at 
all  on  any  other  factor.  The  next  two  variables  to  load,  in 
hierarchical  order,  are  the  "affected  by  feelings"  dimension 
of  V17  and  the  "tense"  dimension  of  V30.  Both  dimensions 
were  factorially  "pure."  The  first  four  loadings  provide 
powerful  support  to  this  as  an  "anxiety"  factor.  Other 
variables  with  appreciable  loadings  which  support  this  as  an 
"anxiety"  factor  are  the  “apprehensive"  dimension  of  V26  and 
the  "undisciplined  self-conflict"  dimension  of  V29.  These 
last  variables  do  not  load  as  cleanly  on  the  anxiety  factor 
but  still  provide  support  for  it. 

There  were  nine  other  variables  which  loaded  between  .2 
and  .34  on  the  "anxiety"  factor.  It  is  unusual  to  have  so 
many  variables  load  on  a  factor  that  is  as  well-defined  as 
this  factor.  In  this  case,  most  of  the  loadings  of  these 
"other"  variables  are  negative  loadings  on  measures  that 
require  performance  under  the  pressure  of  a  time  limit. 

This  would  suggest  that  poor  performance  on  timed  tests  goes 
along  with  high  anxiety.  Such  a  notion  is  supportive  to  the 
factor  as  an  "anxiety"  factor. 

In  the  third  factor,  there  is  not  a  factorially  "pure" 
measure  with  a  high  loading.  However,  the  indications  are 
strong  that  this  is  a  factor  that  can  be  named  "ability  to 
work  under  stress."  The  three  highest  loadings  are  almost 
factorially  "pure"  in  that  the  only  positive  loadings  are  on 
this  factor.  All  three  of  the  measures  (V2-V4)  are  from  the 
Press  Test  which  measures  the  ability  to  work  under  stress. 
The  same  three  measures  had  very  small  negative  loadings  on 
the  "anxiety"  factor,  which  detracts  only  slightly  from  the 
measures  as  independent  of  other  factors. 

The  only  factorially  "pure"  measure  (with  a  loading  of 
only  .35)  is  the  "self-sufficient"  dimension  of  V28.  Since 
the  "self-sufficient"  person  goes  "his  own  way,  making 
decisions  and  taking  action  on  his  own...  discounting  public 
opinion  (Manual  for  the  16PF,  1972,  p.  20),"  it  could  be 
said  that  this  fits  the  character  of  the  "ability  to  work 
under  stress." 

Other  variables  that  load  on  this  factor  which  support 
it  as  the  "ability  to  work  under  stress"  factor  are  the 
Pursuit  Test,  the  Perceptual  Speed  Test  and  the  Language 
portion  of  the  Thurstone  Test.  All  three  of  these  also  load 
on  the  "analytic"  factor,  but  it  could  be  argued  that  the 
time  pressure  present  during  each  test  imposes  another 
demand,  i.e.,  the  need  to  be  able  to  perform  under  stressful 
conditions.  It  is  unfortunate  that  both  the  Pursuit  and  the 
Perceptual  Speed  tests  break  into  so  many  other  factors 
besides  "ability  to  work  under  stress"  and  "analytic.” 
Caution  must  be  exercised  in  analyzing  their  contributions 
differentially  across  the  various  factors. 
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Factor  4  may  be  named  the  "conscientious,  controlled" 
factor.  The  V28  "group-dependent"  dimension  loading  was  as 
high  as  the  V29  "controlled"  dimension  loading  but  it  was 
not  a  clean  loading.  "Group-dependent"  loaded  on  two  other 
factors  in  addition  to  Factor  4.  The  factor  suggests  a 
hard-working,  responsible  nature  for  a  person  who  is  in 
control  of  their  own  behavior  and  emotions.  At  the  same 
time,  it  suggests  the  quality  of  being  obsessed  with 
correctness,  sometimes  to  the  point  of  being  obstinate. 

This  obsession  with  correctness  is  characteristic  of  the 
"humble"  dimension  of  V18  (Manual  for  the  16PF,  1972,  p. 

18),  which  also  loads  highly,  but  not  cleanly  on  Factor  4. 

The  negative  loading  for  Closure  Flexibility  supports 
the  "group  dependent"  dimension  of  this  factor.  Low  Closure 
Flexibility  scores  suggest  f ield-depender.t  behavior,  other 
variables  which  load  between  .2  and  .36  were  Two-Dimensional 
Perception,  the  "relaxed"  dimension  of  V30,  the  GEFT,  the 
Pursuit  Test,  and  the  "outgoing"  dimension  of  VI 5. 

A  possible  name  for  the  fifth  factor  is  the  "trusting, 
outgoing"  factor.  The  Manual  for  the  16PF  (1972,  d.  20) 
describes  a  person  with  the  “trusting"  dimension  as  "free 
of  jealous  tendencies,  adaptable,  cheerful,  uncompetitive, 
concerned  about  other  people,  a  good  team  worker."  The 
“outgoing"  dimension  (p.  17)  describes  a  person  as 
"good-natured,  easy-going. . .  ready  to  cooperate,  attentive 
to  people,  soft-hearted,  kindly,  adaptable...  He  is  generous 
in  personal  relations."  These  two  dimensions  of  personality 
appear  to  be  compatible  in  this  factor.  Other  measures 
which  loaded  on  the  "trusting,  outgoing"  factor  were  of 
considerably  less  magnitude  than  the  two  most  important 
ones.  These  included:  "venturesomeness,"  Perceptual  Speed, 
"low  intelligence,"  "group-dependency,"  Two-Dimensional 
Perception,  and  "humbleness." 

There  were  no  variables  which  cleanly  loaded  on  only 
Factor  6,  therefore,  the  name  for  the  factor  will  simply 
remain  Factor  6.  The  highest  loading  on  Factor  6  was  .68 
which  is  lower  than  the  highest  loading  for  any  other 
factor.  The  variable  with  that  loading  was  the  "happy- 
go-lucky"  dimension  of  V19.  The  dimensions  of  "tender- 
minded"  and  "venturesome,"  from  V22  and  V21  respectively, 
had  the  next  highest  loadings.  Of  these  three,  the 
"venturesome"  dimension  loaded  most  cleanly,  even  though  it 
did  load  on  one  other  factor  ("trusting,  outgoing,"  .46). 

Recall  that  "tender-mindedness"  is  marked  by  dependency 
and  sensitivity;  "happy-go-luckiness"  is  marked  by  a 
carefree  but  impulsive  spirit;  and,  "venturesomeness" 
complements  "happy-go-luckiness"  with  its  uninhibited, 
spontaneous,  and  almost  reckless  character.  Other  variables 
which  load  on  Factor  6  are  Perceptual  Speed,  the 
"self-assured"  dimension  of  V26,  the  Pursuit  Test  and  the 
Two-Dimensional  Perception  Test. 
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Factor  7  is  neater  than  Factor  6  and  can  be  called  the 
"imaginative,  experimenting"  factor.  Both  of  these 
dimensions  were  factorially  "pure"  on  this  factor.  In 
addition,  in  both  cases,  the  other  dimension  for  the 
variable  did  not  load  on  any  factor  at  all.  The  description 
for  "imaginative"  given  in  the  Manual  for  the  16PF  (p.  20) 
characterizes  someone  who  is  “unconventional,  self- 
motivated,  imaginatively  creative...  [with]  inner-directed 
interests...  his  individuality  tends  to  cause  him  to  be 
rejected  in  group  activities."  The  "experimenting"  person 
is  described  as  " free- thinking .. .  more  inclined  to 
experiment  in  life  generally,  and  more  tolerant  of  inconven¬ 
ience  and  change  (p.  21)."  These  two  descriptions  appear  to 
complement  one  another. 

The  "assertive"  dimension  of  V1B  also  loaded  cleanly 
but  not  as  highly  on  the  “imaginative,  experimenting" 
factor.  The  other  dimension  of  V13  loaded  on  three  other 
factors.  Therefore,  while  the  variable  is  not  so 
independent,  the  "assertive"  dimension  of  the  variable  is 
reasonably  independent.  The  self-assured  independent¬ 
mindedness  and  the  aggressive  competitiveness  that  go  with 
|  “assertiveness"  (Manual  for  the  16PF,  ±972,  p.  18)  also  seem 

to  fit  the  character  of  the  factor.  Small  loadings  for 
seven  other  variables  are  also  part  of  the  factor  and  help 
to  alternately  complement  or  confuse  the  issue,  depending  on 
the  variable.  The  others  are:  "happy-go-lucky,"  Pursuit 
Test,  " suspicious , "  "astute,"  "apprehensive",  "group- 
dependent,"  and  Perceptual  Speed. 

After  the  completion  of  the  factor  analyses,  two  sets 
of  variables  were  entered  into  a  canonical  correlation 
analysis.  The  first  set  of  variables  included  the  same 
twenty-nine  variables  that  went  into  the  factor  analyses. 

The  second  set  of  variables  represented  the  dependent 
variables  for  CHAPARRAL  but  did  not  include  all  measures 
provided  by  the  Army.  There  was  little  variance  within  each 
written  test  and  there  was  not  a  measure  for  a  final  written 
test  that  was  based  on  a  larger  set  of  items.  Consequently, 
a  written  composite  measure  was  constructed  by  summing  the 
scores  of  the  four  existing  written  test  measures.  The 
variable  name  for  computer  input  was  WCOMPC  and  stands  for 
"written  composite  CHAPARRAL."  The  canonical  correlation 
summaries  will  reference  this  variable  name. 

Two  other  dependent  variables  were  part  of  the  set: 
the  end  of  course  proficiency  test  for  CHAPARRAL  (WC5)  and 
the  overall  rating  made  by  the  drill  instructor  (ZR6).  Only 
one  measure  for  each  of  these  kinds  of  measures  was  utilized 
because  of  the  lack  of  variance  within  and  between  other 
measures  of  the  same  category. 
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There  were  no  significant  canonical  correlations 
between  pairs  of  canonical  variates.  However,  as  with  the 
REDEYE  canonical  analysis,  it  was  suspected  that  general 
ability  could  be  operating  as  a  confounding  variable  to  mask 
the  effects  of  other  variables  thought  to  be  crucial  to 
performance.  A  summary  table  of  this  canonical  correlation 
analysis  is  presented  in  Table  36  and  includes  the  same 
categories  of  information  as  in  Table  24:  (a)  the 

magnitudes  of  the  eigenvalues,  (b)  the  canonical 
correlations,  (c)  Wilk's  lambda,  (d)  the  chi-square  values, 
(e)  the  degrees  of  freedom,  (f)  the  probabilities  for 
significance,  and  (g)  two  matrices  of  standardized  canonical 
variate  coefficients,  one  for  each  of  the  two  sets  of 
variables  entered  into  the  analysis. 

A  second  canonical  analysis  which  took  into 
consideration  the  masking  effects  of  general  ability  was 
then  performed.  The  seven  variables  of  the  first  set  with 
canonical  variate  coefficients  of  .30  or  greater  were 
entered  into  the  second  analysis.  Likewise  were  all  three 
of  the  variables  of  the  second  set.  A  significant  canonical 
correlation  of  .685  for  the  first  pair  of  canonical  variates 
was  observed  (p.  _<  .003).  Like  in  the  REDEYE  analysis,  this 
confirmed  that  general  ability  had  been  a  confounding 
variable  in  the  first  analysis.  The  results  of  the  second 
canonical  correlation  analysis  are  displayed  in  Table  37, 
which  shows  the  same  categories  of  information  as  were  shown 
in  Table  36. 

The  results  of  the  analysis  can  be  interpreted  as 
follows:  About  47%  of  the  variance  (listed  as  the 

eigenvalue  for  the  first  canonical  correlation)  is  shared  by 
the  pair  of  canonical  variates  listed  as  having  a 
significant  canonical  correlation.  Recall  that  each 
canonical  variate  is  composed  of  varying  degrees  of  the 
original  variables  cf  the  set.  The  size  of  the  coefficients 
for  each  variable  that  make  up  each  canonical  variate 
indicate  the  relative  contributions  of  the  original 
variables  to  the  composition  of  the  variate. 

In  this  analysis,  the  most  important  component  variable 
to  the  variate  for  the  first  variable  set  was  the  GEFT 
(V10),  followed  in  order  by  the  language  portion  of  the 
Thurstone  Test  of  Mental  Alertness  (V7 ) ,  16PF-FQ3: 
Undisciplined  self-conflict/controlled  (V29),  16PF-FQ4: 
Relaxed/Tense  (V30),  State  Anxiety  (V12),  Closure  Speed 
(V6),  and  finally  Trait  Anxiety  (V13).  For  the  second 
variable  set,  the  most  important  component  variable  to  the 
variate  for  the  set  was  the  Written  Composite  score 
(WCOMPC)  followed  in  order  by  the  overall  rating  scale  by 
the  drill  instructor  ( ZR6 )  and  the  End  of  Course  Proficiency 
Test  ( WC5 ) . 
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SUMMARY  OF  CANONICAL  CORRELATION  ANALYSIS  OF  CHAPARRAL  DATA 
AFTER  CONSIDERING  THE  MASKING  EFFECTS  OF  GENERAL  ABILITY  (M=67) 
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Results .  The  results  of  the  CHAPARRAL  analyses  are: 


1.  The  aptitude  profile  combinations  identified  in  the 
REDEYE  sample  were  not  completely  generalizable  to 
the  CHAPARRAL  sample.  Only  Profile  3  was 
generalizable . 

2.  As  with  the  REDEYE  sample,  the  intellectual  ability 
that  emerges  as  a  factor  is  more  specialized  than 
general.  In  the  CHAPARRAL  sample,  the  specialized 
intellectual  ability  is  analytic  ability. 

3.  Based  on  the  results  of  the  factor  analysis,  the 

underlying  factors  that  characterize  men  who 
complete  CHAPARRAL  AIT  Training  are,  in  order  of 
importance:  "analytic",  "anxiety",  "ability  to 

work  under  stress",  "conscientious,  controlled", 
"trusting,  outgoing",  an  unnamed  factor,  and 
"imaginative,  experimenting."  Together,  the  first 
four  factors  explain  44.8%  of  the  total  variance 
while  all  seven  explain  60.6%  of  the  variance. 

4.  General  ability  is  the  most  powerful  predictor  of 
CHAPARRAL  performance,  so  much  so  that  it 
confounds  the  effects  of  other  crucial  factors  in 
performance . 

5.  Analytic  ability  is  the  most  important  factor  in 
surviving  CHAPARRAL  AIT  Training.  Once  the  effects 
of  general  ability  are  taken  into  account,  analytic 
ability  is  still  most  important  in  predicting 
CHAPARRAL  performance  (as  measured  by  the  canonical 
variate  for  CHAPARRAL  performance  measures). 

6.  The  "ability  to  work  under  stress"  factor  is  one  of 
the  three  most  important  factors  to  characterize 
those  who  survive  CHAPARRAL  Training,  yet  it  does 
not  predict  CHAPARRAL  performance  at  all. 

7.  Stated  in  factor  terms,  the  descriptive  components 
which  predict  CHAPARRAL  performance,  in  order  of 
importance  are:  "analytic,"  "anxiety,"  and 
"conscientious,  controlled."  Elements  of  no  other 
identified  factors  were  predictive  of  CHAPARRAL 
performance.  (Appendix  E) 


VULCAN 

Analysis .  The  cases  that  were  analyzed  for  this  report 
included  only  those  for  whom  there  was  a  rating  by  a  drill 
instructor,  all  test  battery  independent  measures,  and  all 
written  and  proficiency  measures  provided  by  the  Army.  The 
rationale  explicated  for  CHAPARRAL  on  the  rating  scales 
applies  to  VULCAN  also.  The  final  number  of  cases  analyzed 


was  61.  AIL  of  the  cautions  expressed  already  about  small 
sample  sizes  for  both  REDEYE  and  CHAPARRAL  apply  to  the 
VULCAN  analysis  too.  Yet  the  fact  that  there  are  three 
similar  analyses  on  different  samples  (even  though  they  are 
small  samples)  does  provide  an  opportunity  for  increased 
generalizability — if  any  promising  results  are  suggested. 

All  aptitude  tests  were  scored  for  all  soldiers  and 
standardized  ratings  (adjusted  for  the  different  raters) 
were  compiled.  Performance  and  written  tests  were  scored  by 
Army  personnel  and  the  scores  were  forwarded  to  the 
investigators.  Descriptions  of  all  dependent  measures  for 
VULCAN  were  given  earlier  in  this  chapter.  A  summary  of  the 
means,  standard  deviations,  and  number  of  cases  on  which 
each  measure  was  based  is  presented  in  Table  38. 

Factor  analyses  were  conducted  following  the  same 
pattern  identified  already  for  REDEYE  and  CHAPARRAL.  The 
factor  analyses  were  intended  to  investigate  the  underlying 
structure  of  the  aptitude  variables  in  the  VULCAN  sample. 

The  correlation  matrix  upon  which  the  factor  analyses  were 
based  is  shown  in  Appendix  D. 

The  number  of  factors  to  be  extracted  in  the  first 
factor  analysis  was  unrestricted  and  yielded  ten  factors 
with  an  eigenvalue  greater  than  one.  A  summary  of  the 
eigenvalues,  percent  of  variance  explained,  and  the 
cumulative  percent  of  variance  for  both  significant  and 
nonsignificant  factors  is  presented  in  Table  39.  The  factor 
matrix  before  rotation  by  the  varimax  method,  the  rotated 
matrix,  and  the  transformation  matrix  for  the  ten  factors 
are  all  shown  on  Table  40.  The  number  of  factors  was  then 
restricted,  partially  because  of  the  results  of  a  scree 
analysis  and  partially  because  of  the  results  of  other 
analyses  of  similar  data  for  REDEYE  and  CHAPARRAL. 

Individual  factor  analyses  were  performed  which 
restricted  the  number  of  factors  to  four,  five,  seven,  and 
eight.  Simple  structure  analyses  revealed  that  the  seven 
factor  solution  was  probably  the  most  meaningful. 

Considering  that  the  other  analyses  (for  REDEYE  and 
CHAPARRAL)  both  resulted  in  seven  factor  solutions,  a  seven 
factor  solution  for  VULCAN  was  desired.  Fortunately,  it  was 
also  an  appropriate  solution  which  met  the  criteria  for 
simple  structure.  Table  41  shows  the  matrices  for  the 
solution  restricted  to  seven  factors.  The  same  criteria  for 
interpretation  of  factor  loadings  was  used  for  VULCAN  as  was 
used  for  REDEYE  and  for  CHAPARRAL  and  will  not  be  repeated 
here . 

Table  42  shows  the  loadings  for  each  factor  in  order  of 
magnitude  starting  with  the  highest  loading.  This  is 
presented  as  such  in  order  to  make  interpretation  easier. 
Based  on  the  loadings  and  on  principles  of  logic, 
a  description  and  discussion  of  each  factor  is  documented. 
Tentative  names  for  the  first  five  are  also  presented. 


TABLE  33 


SUMMARY  OF  MEANS  AND  STANDARD  DEVIATIONS  FOR 
VULCAN  INDEPENDENT  AND  DEPENDENT  VARIA3LES 


V  AR i HULLS •  • 

LABfcL  3  .  . 

ME  AN 

STANDARD  DCV 

CASE  S 

V  i. 

WORD 

62.6197 

16. 7506 

61 

V3 

COUGH 

65.09  64 

14.5461 

61 

V  A 

Wl  NTC 

53. 9836 

13.461o 

6  l 

V3 

CLFLEX 

32 .9506 

2 l . 9889 

61 

V  6 

CLSPD 

9 .49  ia 

4.9619 

61 

V  7 

lth 

la.  4590 

10.1547 

61 

va 

QTH 

15 . 1  1  46 

6.8193 

bl 

V  10 

OEF  T 

5.  36  07 

4.6763 

61 

V  1  1 

PJHSU  1  T 

15.9672 

6.7453 

61 

V  12 

state 

42.1016 

9.4087 

6  1 

V  13 

TRAIT 

43. 1147 

8.5714 

61 

« u 

201M 

l  l  .  1639 

6. 7260 

61 

V  lb 

F  A 

6. 8033 

2.4551 

bl 

V  lb 

Frt 

3. 55  74 

l . 2977 

61 

VI  7 

FC 

6.6721 

2.3785 

bl 

v  la 

F  £ 

5. 90  1  6 

2.0953 

61 

V  IV 

FF 

6.7213 

2.2740 

61 

V20 

F  G 

8.0820 

2. 1079 

61 

V  2 1 

FH 

6.  4590 

2.3063 

61 

V  22 

FI 

4.7869 

1.8629 

61 

V2J 

FL 

6.  3934 

2.1313 

61 

V24 

F  N 

5.2459 

1.9206 

6  1 

V2b 

FN 

5.18  03 

2.0208 

61 

V  2t» 

FO 

6.21  31 

2.0826 

61 

V  2  7 

0  1 

6 . 5  7  33 

2.  1327 

61 

v2a 

02 

5.0984 

2.2709 

61 

V29 

03 

7.  01  64 

1 . 9958 

61 

V  30 

04 

4  .98  36 

2.0453 

61 

V40 

GZPS 

33.  1  475 

10.0727 

61 

•  VI 

29.5574 

5. 3899 

61 

»V2 

31  .6393 

5  .0 101 

6  I 

NV3 

l  7.  6393 

l  .8351 

61 

•  V* 

25.60  33 

2.9201 

61 

»Vb 

21. 1639 

3.6110 

61 

■  Vt> 

FINAL  wt 

85.9016 

8. 0098 

61 

PVC 

profcomp 

7.6721 

1 .3382 

61 
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TABLE  39 


SUMMARY  STATISTICS  FOR  ALL  FACTORS  IN 
UNROTATED  FACTOR  ANALYSIS  OF  61  VULCAN  CASES 


VARIABLE 

VALUE  USED 

IN  DIAGONAL 

FACTOR 

EIGENVALUE 

PCT  OF  VAR 

CUM  PCT 

V2 

1.00000 

1 

1 

5.57544 

15.5 

15.5 

V  3 

1.00000 

2 

3.75401 

10.4 

25.9 

V4 

1.00000 

3 

3.01464 

8.4 

34.3 

V5 

1.00000 

4 

2.07051 

5.8 

40.0 

V6 

1.00000 

5 

1.97277 

5.5 

45.5 

V7 

1 . 00000 

6 

1.74155 

4.8 

50.4 

V  8 

1.00000 

7 

1.62320 

4.5 

54.9 

V10 

1.00000 

8 

1.53643 

4.3 

59.1 

Vll 

1.00000 

9 

1.35102 

3.8 

62.9 

V12 

1.00000 

10 

1.25593 

3.5 

66.4 

V13 

1.00000 

11 

1.21868 

3.4 

69.8 

V14 

1.00000 

12 

1.08644 

3.0 

72.8 

VI 5 

1.00000 

13 

0.97124 

2.7 

75.5 

V16 

1.00000 

14 

0.91008 

2.5 

78.0 

V17 

1.00000 

15 

0.82583 

2.3 

80.3 

V18 

1.00000 

16 

0.73802 

2.1 

82.3 

V19 

1.00000 

17 

0.67346 

1.9 

84.2 

V20 

1.00000 

13 

0.64724 

1.8 

86.0 

V21 

1.00000 

19 

0.59393 

1.6 

87.7 

V22 

1.00000 

20 

0.54380 

1.5 

89.2 

V23 

1.00000 

21 

0.50524 

1.4 

90.6 

V24 

1.00000 

22 

0.41874 

1.2 

91.7 

V  25 

1 . 00000 

23 

0.40532 

1.1 

92.9 

V26 

1.00000 

24 

0.39148 

1.1 

94.0 

V  27 

1.00000 

25 

0.36884 

1.0 

95.0 

V28 

1.00000 

26 

0.28925 

0.8 

95.8 

V29 

1.00000 

27 

0.26816 

0.7 

96.5 

V30 

1 . 00000 

28 

0.24132 

0.7 

97.2 

V40 

1.00000 

29 

0.22978 

0.6 

97.8 

WV1 

1.00000 

30 

0.19581 

0.5 

98.4 

WV2 

1.00000 

31 

0.16031 

0.4 

98.8 

WV3 

1.00000 

32 

0.12683 

0.4 

99.2 

WV4 

1.00000 

33 

0.10347 

0.3 

99.5 

WV5 

1.00000 

34 

0.09175 

0.3 

99.7 

WV6 

1.00000 

35 

0.05497 

0.2 

99.9 

PVC 

1.00000 

36 

0.04458 

0.1 

100.0 
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TABLE  40 

FACTOR  MATRICES  (UNRESTRICTED)  FOR  VULCAN  DATA  (N=61) 
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TABLE  41 


FACTOR  MATRICES  (RESTRICTED  TO  SEVEN  FACTORS) 
FOR  VULCAN  DATA  (N=61) 


FaCTUN  MATRIi  cSlNG  PRINCIPAL  FACTOR.  nQ  ITERATIONS 


f«CTC*  1 

FACTOR  2 

FACTOR  3 

FACTOR  4 

FACTOR  5 

FACTOR  * 

FACTOR  7 

COMMUNAL 1 T 

v2 

0.45 ItS 

0. 02990 

0.477H 

-0.26594 

-0.01326 

0.006 1 3 

-0. 1 7736 

0.  ’334  1 

v  3 

0. TOboB 

-0.01 744 

0.49296 

-0.24340 

0.03099 

-0.10419 

-0.15962 

0.04009 

v  • 

o.  es.0^9 

0. 02096 

0.40194 

-0.  16  764 

0.04 109 

0. 03*2  1 

0.03350 

0. 7a  l  A  1 

*9 

0.4361 a 

0. 02  3  34 

-0.45071 

-0. 12023 

0.40253 

0.06022 

0. 04734 

0.49535 

VO 

0.C94S9 

-0.05039 

-0.06003 

0.29320 

0. 10251 

-0.94 047 

0.0531 0 

0.342  1  3 

v  r 

0.6«41 4 

-0.00  720 

-0. 10023 

0.10014 

-0.43626 

0.92019 

0.23179 

0.7*204 

va 

0. 21020 

0, 05592 

-0.2921  4 

0.19379 

-0.24227 

0.19200 

0.  t  7630 

0.7711* 

V  1  0 

0.47464 

-0. 00325 

-0.34304 

0*10336 

0.30363 

-C. 12*93 

0.20093 

0 . 7b0  60 

V  1  1 

0.4462 1 

0. 16976 

-0. 12373 

-0.32139 

0.23909 

-0. 10909 

0.40001 

0.66*09 

V  1  2 

—  0.27  SO  6 

0.36036 

0.21462 

-0.06730 

0.00296 

0.  19331 

0.23063 

0.3J033 

V  1  v 

-0.221 12 

0. 7 4671 

0.17107 

-0. 09164 

0.13234 

-0.01017 

0.16056 

0. 6*6*4 

V  1  « 

0.3*229 

-0. 00620 

-0.35074 

-0.05140 

0.29761 

0.31 1 03 

-0. 1 0479 

0.4591 7 

VIS 

-0.20407 

-0. 34173 

0.42610 

0. 10491 

0. K  7303 

-0.00776 

0.44669 

0.6120* 

V  1  o 

0.34292 

0.03236 

-0. 1 1 740 

0.300Q6 

-0.23069 

-0.07747 

-0.03073 

0.46020 

v  i  r 

0.06546 

-0. 5931 0 

-0. 1 9760 

-0.29211 

-0.22197 

0.21299 

—0.040 ! 4 

0.37972 

v  i  a 

-0.01472 

3.261 00 

0. 10137 

0.30366 

0.26309 

0.35494 

-0.30503 

0.3v2b7 

V  1  'i 

3.09356 

-0.29089 

0.39667 

0.32773 

0. 10710 

-  0  •  34  0  1  0 

0.06575 

0.6625* 

V  20 

0.45103 

-0.23037 

0.10300 

-0. 16124 

-0. 13206 

-0.22314 

-0.35207 

0 . 3  1  3  3  C 

V  2  l 

-0.09397 

-0.36062 

0.26033 

0.45465 

-0.03416 

0. 1 0999 

0.24132 

0.3257* 

V22 

-0.01232 

0. 19030 

0.37240 

—  0  •  344  77 

0.21050 

0.50073 

0.  14349 

C.  7C096 

v  2  3 

0.3 1072 

0.42731 

0.  10427 

0.  12099 

-0.232  *2 

0.00901 

0.10160 

0.373C  6 

«2« 

0.01 OoS 

-0. 06591 

0. 14624 

-0. 10567 

-0.23290 

0.04 1 79 

0.30996 

0 .21 2*2 

V2S 

0.3165. 

0.27216 

-0.13633 

-0. 17907 

-0.40160 

-0.16104 

0.39137 

0.47106 

V  2  O 

0.05150 

0. 73024 

0*06601 

0.  14406 

-0.23741 

-0.10299 

-0.00337 

G.buOCS 

VJ7 

0.149.9 

-0.  10780 

0. 12636 

0.34077 

-0.19619 

0.67574 

0.12903 

0.7J253 

v2  a 

0.^2763 

0.47436 

-0.25256 

0.  00047 

-0. 16001 

0.16011 

-0.J0459 

0.4*27 1 

v2v 

-0.0/ 1 l 0 

-0.91 332 

0.1 1 530 

-0. 12433 

0.02699 

-0.07945 

-0.03632 

0.30573 

v  3  0 

0.11057 

0.36500 

0.04069 

0.406  i  5 

0. 26324 

-0.  1662 1 

0.00633 

0 .* 1222 

V«0 

o. Tsata 

0.30101 

0.13790 

-0. 006J3 

0. 06003 

-0.01229 

-0.04109 

0.61 333 

VAR1MAA  HOTATtp  FACTOR  NATO  1  * 
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In  the  VULCAN  sample,  the  first  factor  is  the  now 
familiar  "ability  to  work  under  stress"  factor.  All  three 
measures  from  the  Press  Test,  which  measures  the  ability  to 
work  under  stress,  load  cleanly  and  very  highly  on  this 
factor.  The  next  highest  loading  (.64)  is  for  Perceptual 
Speed,  but  it  also  loads  on  both  the  "general  ability" 
factor  (Factor  3)  and  the  "spatial-analytic"  factor  (Factor 
4).  It  makes  sense  that  Perceptual  Speed  might  load  on  ail 
three  of  these  factors.  However,  it  is  especially 
interesting  that  the  highest  weight  for  Perceptual  Speed  is 
clearly  on  the  "ability  to  work  under  stress"  factor  and  not 
on  the  other  two.  In  order  to  score  high  on  this  test,  the 
person  must  perform  under  the  pressure  of  a  short  time 
limit.  In  a  very  short  period  of  time,  he  must  correctly  do 
many  problems  requiring  a  meticulous  attention  to  detail. 
Being  able  to  do  this  apparently  is  more  related  to  the 
ability  to  work  under  stress  than  it  is  to  anything  else. 
Also  loading  cleanly  on  the  factor  is  the  "conscientious" 
dimension  of  V20  (FG).  The  "conscientious"  dimension  is 
described  as  "persevering,  rule-bound,  [and]  responsible," 
(Manual  for  the  16PF,  p.  19).  This  is  complementary  to  the 
notion  of  being  able  to  work  under  stress . 

Other  variables  with  low  or  moderate  loadings  on  the 
"ability  to  work  under  stress"  factor  are:  Closure  Speed, 
the  language  portion  of  the  Thurstone  Test,  the  Pursuit 
Test,  "the  more  intelligent"  dimension  of  FB  from  the  16PF, 
the  "tender-minded"  dimension  of  FI,  and  the  "suspicious" 
dimension  of  FL  also  from  the  16PF.  The  first  three  of  the 
measures  with  moderate  loadings  require  performance  under 
stressful  and/or  time-pressured  conditions. 


Factor  2  can  be  called  the  "anxiety"  factor  since  the 
first  five  measures  which  load  on  it  are  all  clearly  related 
to  anxiety.  Clean  loading  variables  are:  the  "affected  by 
feelings"  dimension  of  FC,  the  "apprehensive"  dimension  of 
FO ,  and  the  "tense"  dimension  of  Q4  (all  from  the  16PF). 

Also  loading  high  on  this  factor  are  trait  and  state 
anxiety,  although  not  as  cleanly  as  the  others  already 
named.  Other  measures  with  appreciable  loadings  are  the 
"undisciplined  self-conflict"  dimension  of  FQ3,  the 
"suspicious"  dimension  of  FL,  and  the  "self-sufficient" 
dimension  of  FQ2,  all  from  the  16PF.  Additional  measures 
with  loadings  of  between  .2  and  .3  on  the  "anxiety"  factor 
are:  Two-Dimensional  Perception  (negatively),  the 

"assertive"  dimension  of  FE,  the  "expedient"  dimension  of 
FG,  and  the  "astute"  dimension  of  FN ,  also  from  the  16PF. 


Factor  3  is  best  called  a  "general  ability"  factor, 
although  it  is  not  a  completely  clean  factor.  A 
particularly  noteworthy  feature  of  the  factor  is  the  absence 
of  almost  all  spatial  and  analytic  measures.  The  three 
highest  loadings  on  this  factor  are  those  designed  as  formal 
measures  of  general  ability;  namely,  the  language  and 
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quantitative  measures  from  the  Thurstone  Test  of  Mental 
Alertness,  and  FB  (less  intelligent/more  intelligent)  from 
the  16PF.  The  language  Thurstone  and  FB  have  some  relation¬ 
ship  to  the  "ability  to  work  under  stress",  factor  while  the 
quantitative  Thurstone  has  some  relationship  to  the 
"spatial-analytic"  factor  (Factor  4).  Quantitative  tests 
are  by  nature  more  analytic  than  general  so  the  relationship 
with  the  "spatial-analytic”  factor  is  not  surprising.  The 
time  pressure  and  alternating  question  types  of  the 
Thurstone  Test  should  be  enough  to  warrant  a  relationship  to 
the  "ability  to  work  under  stress"  factor  for  both  subtests. 
It  is  not  clear  why  the  relationship  was  suggested  for  only 
the  language  subtest.  It  is  also  unclear  why  FB  also  loaded 
on  the  "stress"  factor.  There  was  no  time  limit  or  other 
pressure  inherent  in  the  testing  situation  for  the  16PF  to 
suggest  any  kind  of  stress. 

A  rather  large  number  of  other  measures  also  loaded  on 
this  factor,  many  of  which  suggest  inconsistent 
relationships  with  other  factors  in  the  solution.  Variables 
which  make  sense  in  this  as  a  "general  ability"  factor  are: 
"experimenting,"  high  Closure  Speed,  "suspicious,"  high 
Perceptual  Speed,  “self-sufficient,"  low  trait  and  state 
anxiety,  and  "tough-minded."  According  to  the  Manual  for 
the  16PF,  the  "experimenting"  person  is  "interested  in 
intellectual  matters"  (p.  21),  the  "suspicious"  person  is 
"interested  in  internal,  mental  life  [and  is]  deliberate  in 
his  actions"  (p.  20),  the  "self-sufficient"  person  is 
"accustomed  to...  making  decisions  and  taking  action  on  his 
own"  (p.  22),  and  the  "tough-minded"  person  is  "practical, 
realistic ...  and  independent"  (p.  20).  All  of  these  tz  - 
somewhat  consistent  with  high  general  ability. 

The  fourth  factor  could  be  called  the  "spatial- 
analytic"  factor  and  is  a  rather  clean  and  neat  factor.  The 
GEFT  is  the  highest  loading  measure  and  is  factorially 
"pure."  The  Closure  Flexibility  measure  is  almost 
factorially  "pure"  in  that  the  only  positive  loading  for  it 
is  on  this  factor.  There  is  a  small  negative  loading  for  it 
on  Factor  5,  but  zero  or  near  zero  loadings  on  every  other 
factor.  Both  the  GEFT  and  the  Closure  Flexibility  Tests 
clearly  tap  analytic  ability.  The  Two-Dimensional 
Perception  Test  which  is  the  most  spatially  oriented  of  all 
of  the  measures  in  the  test  battery,  has  its  only  positive 
loading  on  this  factor.  Both  the  Two-Dimensional  Perception 
Test  and  the  Pursuit  Test  load  highly  on  this  factor  and  at 
the  zero  or  near  zero  level  on  the  general  ability  factor. 
Other  measures  which  tap  spatial  or  analytic  skills  which 
load  at  some  level  on  this  factor  are  Closure  Speed, 
quantitative  Thurstone,  and  Perceptual  Speed.  The  last 
measure  with  an  appreciable  loading  on  this  factor  is  the 
"self-assured"  dimension  of  FO  from  the  16PF.  It  is 
noteworthy  that  this  is  the  only  personality  factor  which 
loads  appreciably  on  this  factor.  All  other  factors  in 
the  solution  had  more  than  one  personality  factor  associated 
with  them. 
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Factor  5  might  be  called  the  "outgoing,  happy-go-lucky" 
factor.  The  two  highest  loadings,  for  "outgoing"  and 
"happy-go-lucky"  are  factorially  "pure."  The  next  highest 
loading  is  almost  factorially  "pure"  and  is  for  the 
"venturesome"  dimension  of  FH .  The  "group-dependent" 
dimension  of  FQ2  also  has  a  high  loading  and  is  an  almost 
factorially  "pure"  dimension.  Five  other  variables  have 
loadings  of  between  .2  and  .3  on  this  factor.  They  are: 
Closure  Flexibility  and  Two-dimensional  Perception 
(negatively),  the  "self-assured"  dimension  of  FO ,  the 
"experimenting"  dimension  of  FQ1,  and  the  "controlled" 
dimension  of  FQ3 .  This  factor  is  remarkably  like  the  fourth 
factor  from  the  REDEYE  sample  with  some  exceptions.  The 
exceptions  are  primarily  on  measures  that  had  comparatively 
low  loadings  and  which  were  present  in  the  REDEYE  solution 
but  not  in  the  VULCAN  solution.  The  reader  is  referred  to 
the  discussion  of  the  similar  factor  in  the  REDEYE  chapter 
since  the  discussion  here  would  be  repetitive. 

There  is  no  loading  with  .7  or  higher  on  Factor  6  and 
the  pattern  of  meaning  for  those  variables  that  do  load  on 
this  factor  is  ambiguous.  Consequently,  the  factor  will  be 
called  simply  Factor  6.  The  "humble"  dimension,  which  has 
the  highest  loading  and  which  is  factorially  "pure" 
describes  a  person  who  "tends  to  give  way  to  others"  (Manual 
for  the  16PF,  1972,  p.  18).  The  variable  with  the  next 
highest  loading  on  this  factor  is  the  "astute"  dimension 
which  loads  on  only  one  other  factor  (the  "anxiety"  factor, 
.21).  The  "astute"  dimension  describes  a  person  who  is 
"experienced,  worldly,  shrewd...,  hardheaded  and  analytical" 
(astute,  p.  21).  The  practical/ imaginative  variable  loading 
is  .38  and  is  factorially  "pure."  Included  in  the 
description  of  the  imaginative  dimension  (p.  20)  is 
"oblivious  to  particular  people."  It  is  assumed  that  this 
factorially  "pure"  variable  suggests  that  in  coping  with 
this  situation  there  are  constraints  set  as  to  whom  one 
behaves  in  a  humble  manner. 

The  other  variables  with  appreciable  loadings  on  Factor 
6  are:  the  Pursuit  Test  and  the  Language  Thurstone 
(positively),  the  Two-dimensional  Perception  Test 
(negatively),  and  the  personality  dimensions  of  "sober," 
"conservative,"  "group  dependent,"  and  "relaxed."  In 
summary.  Factor  6  is  not  easily  interpreted. 

The  seventh  factor  will  be  called  Factor  7  as  there  are 
no  variables  which  load  cleanly  on  it.  This  factor  also  is 
made  up  of  primarily  personality  characteristics.  The 
highest  loading  was  for  "tender-minded"  which  also  loaded  on 
the  "ability  to  work  under  stress"  factor.  As  has  been 
stated  earlier,  " tender-mindedness"  is  marked  by  dependency 
and  sensitivity.  The  other  personality  measures  which  load 
on  the  factor  are:  the  "experimenting"  dimension  of  FQ1, 
high  state  and  trait  anxiety,  the  "sober"  dimension  of  FF 
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and  the  "assertive"  and  "expedient"  dimensions  of  FE  and  F3 
respectively.  The  only  measure  which  loads  on  Factor  7 
which  is  not  a  traditional  personality  measure  is  the  "less 
intelligent"  dimension  of  FB .  Like  Factor  6,  Factor  7  is 
not  particularly  easy  to  interpret. 

Canonical  correlation  analyses  were  performed  for  the 
VULCAN  data  in  the  same  way  that  similar  analyses  were 
performed  for  REDEYE  and  CHAPARRAL.  The  same* set  af 
variables  went  into  the  first  set  for  canonical  correlation 
analysis  as  went  into  the  first  set  of  variables  for 
CHAPARRAL.  Three  measures  were  entered  with  the  second  set: 
WV6  (Final  Written  Vulcan  Test),  PVC  (Proficiency  composite 
score — VULCAN),  and  ZR6  (the  overall  rating  score  already 
explained  elsewhere) . 

No  significant  canonical  correlations  were  observed  as 
a  result  of  the  first  analysis.  The  summary  of  the 
canonical  correlation  analysis  just  described  can  be  found 
in  Table  43  and  includes  all  of  the  information  already 
outlined  under  similar  discussions  earlier  in  this  report. 

In  order  to  investigate  the  masking  effects  of  general 
ability,  the  second  canonical  analysis  was  performed.  Only 
the  eight  variables  from  the  first  set  with  coefficients  of 
+  .30  or  greater  on  the  first  variate  in  the  first  analysis 
were  submitted  to  the  second  analysis.  Similarly,  only  the 
two  variables  from  the  second  set  which  met  this  criteria 
were  entered  into  the  second  analysis.  There  was  a 
significant  canonical  correlation  of  .529  between  the  first 
pair  of  canonical  variates  (£  _<  .011).  Almost  40%  of  the 
variance  was  shared  by  the  pair  of  canonical  variates.  The 
results  of  the  second  canonical  correlation  analysis  are 
listed  in  Table  44. 

For  the  VULCAN  analysis,  the  component  variable  with 
the  greatest  weight  to  the  variate  from  the  first  variable 
set  was  V13  (Trait  Anxiety).  In  order  of  importance,  the 
other  variables  that  contributed  to  the  variate  were:  V30 
(16PF-FQ4:  Relaxed/Tense),  V21  (16PF-FH:  Shy/Venturesome), 

V26  ( 16PF-FO:  Sel f-Assured/Apprehensive ) ,  V12  (State 
Anxiety),  V15  ( 16PF-FA:  Rese rved/Outgoing ) ,  V10  (GEFT),  and 
finally  V4  (Color  Naming  with  Distraction  from  the  Press 
Test).  For  the  variate  from  the  second  variable  set,  PVC 
(the  Proficiency  Composite  score)  contributed  most,  followed 
by  WV6  (the  Final  Written  VULCAN  Test). 

Results .  The  results  of  the  VULCAN  analyses  are: 

1.  The  aptitude  profile  combinations  identified  in  the 
REDEYE  sample  were  not  completely  generalizable  to 
the  VULCAN  sample.  Only  Profiles  2  and  3  were 
genera  1 izable . 
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SUMMARY  OF  CANONICAL  CORRELATION  ANALYSIS  OF  VULCAN  DATA 
BEFORE  CONSIDERINO  THE  MASKING  EFFECTS  OF  GENERAL  ABILITY  ( N  =  6 1  ) 
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2.  Intellectual  ability,  in  this  sample  splits  into 
two  distinct  factors,  a  “general  ability"  factor 
and  a  specialized  "spatial-analytic"  factor,  both 
of  which  explain  less  variance  than  some  factors 
more  closely  related  to  personality. 

3.  Based  on  the  factor  analysis,  the  "ability  to  work 
under  stress"  factor  appears  to  be  the  most 
important  factor  in  surviving  VULCAN  training,  but 
based  on  the  canonical  correlation  analysis,  it  is 
not  as  predictive  of  performance  as  is  the 
"anxiety"  factor  or  the  "outgoing,  happy-go-lucky" 
factor . 

4.  The  underlying  factors  that  characterize  men  who 

complete  VULCAN  Training  are,  in  order  of 
importance:  "ability  to  work  under  stress," 

"anxiety,"  "general  ability,"  "spatial-analytic 
ability,"  "outgoing,  happy-go-lucky,"  and  two 
unnamed  factors.  The  first  four  factors  explain 
40%  of  the  total  variance  while  all  seven  explain 
54.9%. 

5.  General  ability  is  crucial  to  successful  VULCAN 
performance  but  masks  the  effects  of  other  crucial 
factors . 

6.  Once  the  masking  effects  of  general  ability  are 
taken  into  consideration,  the  components  predictive 
of  VULCAN  performance,  in  order  of  importance,  are: 
"anxiety,"  "outgoing,  happy-go-lucky,"  "ability  to 
work  under  stress,"  and  "spatial-analytic"  ability. 
Elements  of  no  other  identified  factors  contributed 
to  the  prediction  of  VULCAN  performance. 

(Appendix  E) 

7.  The  effects  of  personality  factors  contribute  far 
more  to  the  prediction  of  VULCAN  task  performance 
than  they  do  to  the  underlying  structure  of 
abilities  of  the  men  who  complete  VULCAN  training. 


» 
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CHAPTER  V 


DISCUSSION  AND  RECOMMENDATIONS 
Discussion 


It  is  instructive  to  compare  the  results  of  the  factor 
analyses  for  REDEYE,  CHAPARRAL,  and  VULCAN.  Each  was 
presented  and  discussed  separately  earlier  in  this  report. 
Table  45  shows  the  information  of  Tables  23,  35,  and  42  all 
on  the  same  tfcble  so  as  to  facilitate  comparisons  between 
the  seven  factors  in  each  sample.  The  same  information  is 
condensed  on  Table  46. 

In  che  factor  analyses  summarized  in  Tables  45  and  46, 
the  groups  described  can  be  thought  of  as  having  all  been 
successful  in  completing  the  specific  training.  Three 
character istics  were  identified  which  strongly  influence  the 
successful  learning  of  a  complex  psychomotor  task.  They  are 
Analytic/Spatial,  Ability  to  Work  Under  Stress  and  Anxiety. 
Although  analytic  qualities  are  very  often  measured  along 
with  general  ability,  the  spatial  and  nonverbal  analytic 
components  were  stronger  predictors  of  whether  a  trainee 
would  complete  training.  They  survived  as  independent 
factors  even  after  adjusting  for  the  strong  effects  of 
general  ability.  Stress  and  anxiety  measures  had  been 
considered  one  characteristic  in  the  previous  contract 
studies  (Hebein,  1978;  Sullivan  et  al.,  1978),  howe\ er, 
they  now  appear  to  be  clearly  different  in  their  effects  on 
learning . 

Although  these  three  factors  were  the  most  important 
factors  for  all  three  systems,  (REDEYE,  CHAPARRAL,  and 
VULCAN)  their  relative  position  changed  as  shown  in  Table 
46.  The  most  drastic  change  occurred  with  analytic/spatial 
which  contributed  to  about  twenty  percent  of  the  variance  in 
REDEYE  and  CHAPARRAL  and  less  than  six  percent  in  VULCAN. 

To  the  instructional  developer,  techn: ques  are 
available  to  treat  the  anxiety  and  analytic  characteristics 
but  there  is  very  little  research  to  indicate  methods  for 
exploiting  the  ability  to  work  under  stress  or  compensating 
for  the  lack  of  it.  The  stress  factor  never  appealed  later 
than  third  but  is  first  in  the  VULCAN  case.  It  seems  that 
there  is  something  different  about  the  VULCAN  task  or  the 
learning  environment  which  makes  the  ability  to  work  under 
stress  more  important  than  are  intellectual  abilities. 

After  these  common  factors,  different  sets  of 
personality  variables  cluster  into  what  would  appear  to  be 
task  related  or  learning  environment  related  factors. 

The  most  frequent  variables  were  "Sober/Happy-go-lucky'', 
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"Shy/Venturesome " ,  and  "Reserved/Outgoing."  The  lefthand 
descriptors  tend  to  indicate  individuals  who  would  profit 
more  from  group  training  while  the  righthand  desciptors 
would  probably  be  more  suited  to  self  study.  These  factors 
have  been  the  subject  of  little  direct  research  so  that  no 
substantive  conclusions  can  made  as  to  prescibing  specific 
treatments.  REDEYE  factor  four  is  clearly  the  same  as  VULCAN 
factor  five  and  while  this  lends  some  evidence  that  the 
analysis  method  is  reliable,  it  offers  little  insight  into 
how  one  applies  such  a  factor  to  the  training  task. 

Table  47  displays  the  descriptive  components  stated  in 
factor  terms  which  predict  task  performance  and  retention. 
Here  it  is  notable  that  the  REDEYE  task  has  more  descriptors 
than  do  the  other  two  tasks.  This  is  most  probably 
explained  by  the  fact  that  the  REDEYE  population  had  'been 
REDEYE  gunners  for  a  considerable  time,  while  the  others 
were  just  completing  training.  Normal  attrition  in  this  MOS 
may  have  caused  the  characteristics  to  converge  on  this 
profile . 

The  REDEYE  and  CHAPARRAL  profiles  change  very  little 
from  the  factor  analysis  to  the  canonical  analysis.  No 
factor  changes  more  than  one  column  although  many  of  the 
CHAPARRAL  factors  disappear.  VULCAN  factors  change  in  order 
of  importance  from  the  factors  representative  of  soldiers  in 
VULCAN  training  to  components  predicting  successful  VULCAN 
training  performance.  It  would  appear  that  the  factors  which 
predict  successful  completion  of  VULCAN  training  are 
different  from  those  predicting  high  or  low  VULCAN  training 
performance.  It  should  be  noted  here  that  the  VULCAN 
dependent  measures  were  the  least  objective  of  all  the 
outcome  measures  and  that  anxiety  becomes  the  first  factor 
when  predicting  VULCAN  performance. 

The  behavior  of  the  "ability  to  work  under  stress"  is 
always  an  important  factor  in  predicting  the  completion  of 
training.  When  looking  at  the  performance  measures  it 
becomes  less  important  as  the  size  of  the  team  grows. 
Components  of  the  "ability  to  work  under  stress"  factor  are 
most  important  in  REDEYE,  the  one  man  task,  but  drop  to 
third  in  VULCAN,  a  four  man  task.  They  drop  out  altogether 
in  CHAPARRAL,  the  five  man  task.  It  would  appear  that  the 
effects  of  stress  can  be  distributed  within  a  population. 

This  phenomenon  indicates  that  the  Stress  factor  must 
always  be  considered  when  designing  training  regardless  of 
the  team  size.  It  may  or  may  not  be  a  serious  factor  when 
the  trainee  goes  into  the  field. 

One  could  speculate  that  the  personality  factors  would 
be  more  important  in  training  than  in  performance  because  of 
the  possible  influence  they  might  have  in  the  interpersonal 
relationship  between  the  trainee  and  the  instructor  to 
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TABLE  47 
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me r-iase  the  individuals  share  of  the  training  time.  This 
dees  not  seem  to  be  the  case,  as  " sober/happy-go-lucky" 
components  improved  the  contribution  to  prediction  in  the 
canonical  analysis  with  both  REDEYE  and  VULCAN  while 
"conscientious/controlled"  moved  up  to  third  with  CHAPARRAL. 
It  should  not  surprise  anyone  responsible  for  training  that 
the  characteristics  required  to  learn  a  task  are  not 
necessarily  the  same  as  those  characteristics  required  to  do 


Recommendations 

The  "ability  to  work  under  stress"  should  be  more 
closely  investigated  to  develop  operational  parameters  and 
instuctional  strategies  to  optimize  the  factor  in  the 
development  of  training  materials.  Some  investigation  into 
the  question  of  how  much  stress  should  be  incorporated  into 
the  training  in  relation  to  the  amount  of  stress  in  the  task 
would  be  of  immediate  use.  Stress,  in  the  medical  sense, 
is  being  studied  intensely  at  present  to  determine  its 
effects  on  productivity.  An  educational  definition  may  be 
timely. 

The  instruments  used  in  this  study  seem  to  be  valid 
measures  of  the  ability  to  work  under  stress.  The  factors 
remained  relatively  pure  through  several  levels  of  analysis. 

There  may  be  strategies  to  teach  people  to  work  under 
stress  better  than  they  would  normally.  This  would  be 
useful  as  beginning  instruction  for  a  task  identified  as 
being  stressful. 

Although  the  term  “specialized  general  ability"  would 
seem  to  be  paradoxical,  the  intellectual  measures  which 
traditionally  load  on  general  abiLity  seem  to  be  leaning 
toward  the  spatial  imaqery  skills  and  are  only  useable  after 
a  certain  threshold  of  general  ability  is  attained.  Some 
investigation  *-0  clarify  this  relationship  may  prove 
productive . 

No  firm  conclusions  can  be  drawn  about  the  efficiency 
of  the  strategies  used  in  the  REDEYE  study  until  the 
methodology  can  be  refined  to  include  better  controls, 
larger  N,  and  clearer  measures  of  performance. 

However,  there  was  reason  to  believe  as  a  result  of 
the  study  that  some  strategies  designed  for  some  groups  were 
in  fact  effective.  For  example,  in  more  instances  than  not, 
Strategy  3  was  more  effective  for  Profile  3  than  were  other 
strategies.  This  was  especially  true  for  Film  12  Retention. 
Those  who  received  Strategy  3  who  had  Prc'j.  .  3  contributed 
enough  to  make  Profile  3  people  outperform  all  other 
profiles  on  Film  12  Retention.  This  was  the  only  instance 
when  Profile  3  outperformed  every  other  profile  group.  In 


all  other  cases,  Profile  3  scored  lower  than  every  other 
profile  group.  While  there  was  no  significant  interaction 
observed,  such  an  occurrence  arouses  speculation  that  some 
kind  of  interaction  effect  was  present. 

Consequently,  it  seems  reasonable  to  conclude  that  poor 
performance  by  certain  profile  groups  could  be  mediated  by 
particular  strategies,  as  appeared  to  be  the  case  with 
Profile  3  on  Film  Retention  for  those  who  received  Strategy 
3  (just  mentioned).  This  conclusion  cannot  be  stated  more 
firmly  because  there  were  not  enough  people  with  Profile  2 
who  received  Strategy  2  or  enough  people  with  Profile  1  who 
received  Strategy  1  to  be  able  to  generalize  across  all 
profiles.  It  was  unfortunate  that  this  complex  aptitude  x 
treatment  interaction  methodology  did  not  receive  an 
adequate  test  in  the  present  study.  It  remains  a  promising 
approach  for  the  improvement  of  military  training--if 
appropriate  controls  can  be  maintained. 

Personality  variables  such  as  Sober/Happy-go- lucky , 
Shy/Venturesome  and  Reserved/Outgoing  do  contribute 
significantly  to  the  prediction  of  learning  and  performing 
certain  cognitive/psychomotor  tasks.  They  have  not  been 
investigated  in  depth  and  as  a  result  do  net  have 
corresponding  instructional  uses.  Studies  using  only  these 
variables  might  allow  some  theory  to  develop. 

There  are  still  some  reasonably  clean  factors  which 
present  the  researcher  with  the  dilemma  of  trying  to  guess 
what  they  are.  Continuing  research  to  clarify  these 
contributing  characteristics  should  be  encouraged. 
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APPENDIX  A 


DETAILED  DESCRIPTIONS  (in  outline  form) 

OF  THE  FOUR  INSTRUCTIONAL  STRATEGIES  USED  IN 
THE  REDEYE  STUDY 


STRATEGY  1:  DETAILED 

I.  GROUP  VS.  INDIVIDUAL  INSTRUCTION 

Was  primarily  individual  in  that  all  information  was 
presented  via  the  self-paced  packet.  The  only  group 
requirement  was  to  get  the  packet  and  receive  general 
instructions  on  what  they  could  or  could  not  do 
before  testing.  Men  could  work  in  groups,  with  a 
buddy,  or  alone.  That  was  their  decision  to  make. 


A.  Print,  in  the  form  of  a  self-paced  packet  (with 
some  photos  and  diagrams). 

B.  Dummy  model  of  weapon  made  available  for  those 
who  wanted  to  practice  firing  sequence  ( outside 
simulator) . 

C.  Pictures  of  aircraft  posted  on  walls  or  model 
airplanes  hanging  from  ceiling.  These  were  not 
in  the  MTS  itself  but  were  in  adjoining  or  nearby 
rooms  and/or  hallways 

D.  The  simulator  itself  for  practice  for  those  who 
requested  it. 

III.  SEQUENCE 

A.  Of  Presentation  Modes: 

1.  Print  (definitely). 

2.  Visuals  within  the  print  materials. 

3/4/5/6.  Maybe  Simulator. 

3/4/5/6.  Maybe  a  Model. 

3/4/5/6.  Maybe  only  Mental  Imagery. 

3/4/5/6.  Maybe  Visuals  other  than  those  embedded 
within  the  print  materials . 

B.  Of  events  during  training  period: 

1.  Men  were  gathered  into  the  MTS  in  their 
group,  where  they  met  for  approximately  3 
minutes  to  find  out  what  they  were  supposed 
to  do . 
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2.  Men  were  dismissed  to  go  through  their 
self-paced  training. 

3.  Men  "did  their  own  thing”  without 
supervision . 

4.  Men  returned  at  appointed  time  or  sooner. 

5.  Men  were  dismissed  for  lunch  as  training  was 
over . 

IV.  PACING  —  Individual 

V.  MOTIVATION  (Including  Social  Atmosphere) 

Intrinsic  motivation.  No  one  was  supervising  to  make 
sure  they  did  what  was  suggested;  it  was  strictly  up 
to  them  to  motivate  themselves.  Any  interactions 
they  had  with  others  were  as  a  result  of  their  own 
e  f  forts . 

VI .  STRUCTURE 

A.  Of  the  materials  themselves: 

Print  packet  was  highly  structured  and  step  by 
step,  although  it  was  somewhat  verbally  loaded  in 
parts . 

3.  Of  the  training  situation: 

There  was  virtually  no  structure  other  than  a 
definite  starting  and  ending  point.  There  was 
nothing  done  to  insure  that  all  of  the  content  of 
the  packet  was  "covered." 

VII.  PRACTICE 

A.  Mental  (as  in  observing  others)  and/or  actual 
practice  in  the  simulator  was  optional .  It  was 
not  required  and  was  experienced  only  at  the 
discretion  of  each  individual. 

B.  Practice  with  the  dummy  model  outside  the 
simulator  was  also  done  only  at  the  discretion  of 
each  individual. 

C.  Mental  practice  outside  the  simulator  was  also  a 
possibility,  although  not  required. 

VIII.  FEEDBACK 

A.  No  extrinsic  feedback  was  provided  as  part  of  the 
training . 
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B.  Individuals  provided  their  own  feedback,  if  any 
was  to  be  received. 


STRATEGY  2;  DETAILED 

I.  GROUP  VS.  INDIVIDUAL  INSTRUCTION  —  Group 

II.  PRESENTATION  MODES 

A.  Diagrams 

B.  Visuals  (still) 

C.  Simulator 

D.  'Videotape  (motion  visual) 

E.  Discussion 

F.  Demonstration 


III.  SEQUENCE 

A.  Of  Presentation  Modes: 


1.  Videotape 

2.  Visual/Diagrams 

3.  Diagrams 

4.  Discussion 

5.  Visual 

6.  Visual/Print 

7.  Discussion 

8.  Visual 

9.  Print 

10.  Discussion 

11 .  Simulator 

12.  Demonstration  in  simulator 

13.  Visual 

14.  Discussion  during  visual 

15.  Simulator 


B.  Of  events  during  training  period: 

1.  Nineteen  minute  videotape:  "Introduction  to 
Redeye . " 

2.  Slide  set  on  general  use  of  weapon, 
emphasizing  maximum  and  minimum  angles  for 
firing  (script  read  live  by  instructor). 

3.  Quiz  #1  on  angles. 

4.  Supportive  feedback  discussion  on  quiz. 

5.  Slide  set  on  nomenclature  of  weapon,  repeated 
twice  (script  read  live  by  instructor). 
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LV. 


VI  . 


6.  Quiz  #2  on  nomenclature. 

7.  Supportive  feedback  as  in  #4  above. 

8.  Slide  set  on  firing  sequence  (script  read 
live  by  instructor) . 

9.  Quiz  #3. 

10.  Supportive  feedback  as  in  *4  and  =7. 

11.  Ten  to  fifteen  minute  break. 

12.  Moved  to  simulator:  "hands  on"  experience. 
Two  passes  each  on  slower  aircraft.  They 
were  told  not  to  be  concerned  about  getting 
the  correct  firing  sequence. 


13.  Demonstration  by  instructor  in  simulator. 

14.  Back  to  classroom:  Slide  set  on  range 
estimation,  identification  of  aircraft  and 
range  ring  coverage.  Give  and  ta<e 
discussion  and  reasoning  on  each  example 
working  backwards  and  forwards  from  certain 
reference  points,  while  slide  set  was  going. 

15.  Actual  practice  (not  tasting):  They  were 
told  to  be  concerned  with  both  sequence  and 
with  getting  hits  this  time. 

3  passes  each  on  slow  aircraft  (Film  5) 

3  passes  each  on  fast  aircraft  (Film  9) 

PACING  --  Group 

MOTIVATION  (Including  Social  Atmosphere) 

Provided  by  instructor  in  a  supportive  fashion. 

There  were  periodic  quizzes  after  each  small  chunk  of 
information  that  were  constructed  for  success  and 
were  therefore  externally  motivating.  The  peer  group 
modeled  the  supportive  manner  of  the  instructor 
providing  a  friendly  and  non- threatening,  yet  mild 
competition . 

STRUCTURE 

A.  Of  Materials: 


1.  Started  with  mostly  simple  information  and 
progressed  to  more  complex. 

2.  Used  as  few  words  as  possible  keeping 
information  only  to  minimum  essentials. 
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B.  Of  the  Training  Situation: 

1.  Demands  made  on  tests  and  during  practice 
started  very  low  and  continued  to  increase; 
as  training  continued,  more  was  expected. 

2.  Entire  training  period  proceeded  in  small 
steps  and  in  step  by  step  process  with  each 
activitv  being  rather  short  in  and  of  itself 

VII.  PRACTICE 

Distributed  actual  practice  in  the  simulator  with 
more  at  the  end  of  training  than  earlier  in  training 

VIII.  FEEDBACK 

It  was  immediate,  corrective,  supportive  and 
continual  in  both  written  and  practice. 

STRATEGY  3:  DETAILED 

I.  GROUP  VS.  INDIVIDUAL  INSTRUCTION  —  Group 

II.  PRESENTATION  MODES 

A.  Videotape  (motion  visual) 

3.  Simulator 

III.  SEQUENCE 

A.  Of  Presentation  Modes: 

1.  Videotape 

2.  Simulator 

B.  Of  events  during  training  period: 

1.  Short  clip  (about  3  minutes)  from  same 
videotape  shown  in  Treatment  $2.  (Only  the 
part  on  the  firing  sequence  was  shown.) 

2.  Instructor  demonstration  on  activation 
procedure  (once  with  empty  weapon). 

3.  Instructor  gave  rules  of  engagement  once 
orally . 

4.  Soldiers  practiced  on  Film  5  in  the 
simulator . 
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5.  Soldiers  practiced  on  Film  9  in  the 
simulator . 

6.  Men  were  dismissed  for  lunch  at  the  end  of 
training . 

PACING  --  Group 

MOTIVATION  (Including  Social  Atmosphere) 

Extrinsic  and  provided  in  part  by  the  competitive 
atmosphere  of  the  peer  group  that  was  allowed  to 
emerge.  The  desire  for  approval  was  intended  to 
motivate  and  approval  was  not  easy  to  get  for  those 
in  this  strategy. 

STRUCTURE 

A.  Of  the  Materials: 

The  only  thing  other  than  practice  and  verbal 
instructions  was  the  short  3-minute  videotape 
segment  and  it  gave  a  step  by  step  sequence, 
which  is  of  course  highly  structured. 

B.  Of  the  training  situation: 

1.  The  bare  minimum  of  instruction  was  presented 
--  virtually  all  verbally  by  the  instructor. 
His  remarks  were  always  made  at  a  simple 
level  and  any  content  was  presented  in  small 
steps.  Therefore,  the  direct  instruction  was 
structured . 

2.  The  practice  proceeded  from  easier  targets  to 
harder  targets  which  is  also  a  structured 
approach . 

3.  HOWEVER,  since  practice  was  the  main  method 
of  instruction  and  since  they  got  so  much  of 
it  compared  to  other  groups,  it  might  be 
stated  that  there  was  less  structure  in  the 
training  situation  (for.  the  most  part)  than 
for  the  other  groups.  This  was  because  ever 
though  the  men  had  to  be  present  together 
during  all  practice,  there  was  a  loose  and 
unstructured  atmosphere  to  the  situation. 

Such  a  situation  was  able  to  develop  because 
of  the  lack  of  formal  instruction. 

4.  The  men  learned  things  more  experiential ly 
than  conceptually,  in  contrast  to  the  other 
groups.  In  this  sense  there  was  less 
structure  than  in  other  groups--a  more 
inductive  approach. 


VII  . 


PRACTICE 
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jt  was  the  main  method  of  instruction,  therefore, 
it  was,  in  a  sense,  massed  practice, 

B.  Since  onlv  2  people  could  physically  practice  at 
a  time  it~was  necessarily  somewhat  distributed 
for  each  person. 

C.  The  total  atmosphere  ot  the  practice,  if  you 
consider  both  mental  and  physical  practice,  was 
definitely  massed  rather  than  distributed. 

VIII.  FEEDBACK 

A.  Immediate  through  practice. 

3.  Provided  primarily  when  something  wrong  was  done. 

C.  Was  minimal  in  terms  of  corrective  information. 

D.  Given  by  both  instructor  and  peers  in  a  negative 
way . 


STRATEGY  4:  DETAILED 

I.  GROUP  VS.  INDIVIDUAL  INSTRUCTION  --  Group 

II.  PRESENTATION  MODES 

A.  Visuals  (still) 

B.  Lecture 

C.  Diagrams 

D.  Simulator 

E.  Discussion 

F.  Videotape  (motion  visual) 

G.  Print 

III.  SEQUENCE 

A.  Of  Presentation  Modes: 

1.  Videotape 

2.  Visual/diagrams  with  lecture 

3.  Discussion  (during  visuals) 
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4.  Visual/diagrams  with  lecture 

5.  Print 

6.  Visual 

7.  Print 

8.  Simulator 

3.  Of  events  during  Training: 

1.  Videotape  (same  as  in  Treatment  #2). 

2.  Part  I  of  slide  set  on  techniques  of  fire 
with  lecture  live  from  instructor  to 
accompany  slides  . 

3.  Discussion  in  question  and  answer  format 
while  slide  set  was  going  (for  material  of 
Part  I . ) . 

4.  Break. 

5.  Part  II  of  slide  set  on  techniques  of  fire 
with  lecture  live  from  instructor  to 
accompany  slides. 

6.  Written  quiz  on  techniques  of  fire. 

7.  Self  evaluation. 

8.  Break. 

9.  Techniques  of  fire  test  (written)  with  some 
items  requiring  judging  something  from  a 
visual  on  a  slide. 

10.  Practice  on  film  9  in  simulator;  2  passes 
per  person  only. 

11.  Dismissal  for  lunch  at  the  end  of  training. 

IV.  PACING  —  Group 

V.  MOTIVATION  (including  Social  Atmosphere) 

A.  Extrinsic  motivation  in  that  a  criterion  was  set 

up  at  the  beginning  of  instruction  of  90%.  The 

soldiers  were  told  they  must  meet  it. 
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3.  Although  it  did  not  happen  with  the  particular 
military  instructor  that  participated  in  this 
study,  usually  the  regular  army  training  is  based 
on  negative  incentives  motivation  (e.g.,  "If  you 
don't  do  well,  I’m  going  to  put  you  or  detail  for 
8  hours" ) . 

VI .  STRUCTURE 

A.  Of  the  Materials: 

1.  The  script  was  r.ot  as  structured  as  the  one 
in  Treatment  42,  primarily  because  the  same 
information  was  repeated  in  more  than  one 
place  with  intervening  information  on  other 
material  in  between. 

2.  Also,  some  of  the  sequential  information  was 
embedded  within  some  of  the  other 
information.  There  were  not  clear 
separations  in  the  presentation  from  one 
topic  to  another. 

3.  However,  there  was  a  structure  that  was 
repeated  several  times  in  the  repetition 
sequence  so  that  within  smaller  segments 
there  was  more  structure. 

4.  There  were  a  lot  of  words  for  each  slide  -- 
fewer  words  may  have  provided  more  structure. 

3.  Of  the  Training  Situation: 

It  was  structured  in  that  it  went  right  along 
from  one  activity  to  another  and  clear 
expectations  were  set. 

VII.  PRACTICE 

Very  limited  actual  practice  at  the  end  of  training. 

VIII.  FEEDBACK 

Immediate  on  both  tests  and  practice,  but  given  with 

a  more  neutral  attitude  than  in  either  Group  2  or  3 . 
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APPENDIX  B 


EXCEPTIONS  TO  STANDARD  EXPERIMENTAL 
PROCEDURES  DURING  REDEYE  STUDY 


This  appendix  describes  the  exceptions  to  the  standard 
field  procedures  that  occurred  at  each  fort.  In  addition, 
any  information  about  the  overall  experimental  conditions  at 
each  fort  that  might  provide  insights  to  later 
interpretation  of  the  findings  are  documented. 

At  Fort  Carson,  training  was  conducted  on  the  first  day 
and  aptitude  testing  on  the  second  day  as  planned.  For 
performance  testing  on  the  first  day,  the  print  of  Film  10 
that  was  available  was  very  old  and  was  not  in  good  working 
order.  There  was  no  other  print  of  Film  10  available  and  no 
other  film  has  the  same  target  representation  as  does  Film 
10.  There  was  no  other  choice  but  to  use  the  bad  print  of 
the  film.  If  any  other  film  were  used  instead,  it  would 
invalidate  the  performance  testing  because  the  men,  across 
all  forts  would  then  not  be  tested  at  the  same  skill  level. 

During  testing,  12  of  the  20  targets  on  Film  10 
appeared  in  a  normal  enough  manner  that  they  could  be 
engaged  by  the  gunners  just  as  would  any  target  on  a  film  in 
good  working  order.  The  other  8  targets  appeared  with 
erratic  motion  that  sometimes  defied  the  capabilities  of  any 
aircraft.  For  example,  some  high  performance  jets  moved 
across  the  sky,  took  a  dive  into  the  ground  and  continued  to 
fly  on  the  ground  before  abruptly  changing  direction  to 
bounce  back  and  forth  between  sky  and  ground.  Since  gunners 
are  not  trained  to  engage  targets  like  that,  having  to 
engage  such  a  target  would  be  an  unfair  test  of  a  gunner. 
There  was  no  way  to  predict  which  targets  would  behave 
erratically.  Consequently,  as  soon  as  it  became  clear  that 
a  gunner  was  faced  with  such  a  target,  he  was  told  to 
disregard  it  and  was  given  another  target  instead.  While 
this  provided  a  small  amount  of  extra  practice  for  some 
gunners,  every  gunner  seemed  to  have  an  equal  chance  to  be 
faced  with  an  erratic  target.  In  other  words,  it  appeared 
to  randomize  itself  out.  Other  than  the  problem  with  Film 
10,  everything  at  Fort  Carson  proceeded  according  to  plan. 

Such  was  not  the  case  at  Fort  Bragg,  however.  Upon 
arrival  at  Fort  3ragg  the  day  before  training  was  to  begin, 
it  was  brought  to  the  attention  of  the  investigator  and 
assistants  that  the  soldiers  who  ha i  been  tasked  for  two 
days  of  training  wouLd  not  be  released  for  that  duty. 
Instead,  the  division  commander  had  called  a  surprise 
inspection  that  would  prevent  them  from  participating  in  the 
study.  On-site  coordination  involving  the  R&D  coordinator, 
members  of  the  XVIII  Corps  ADA  element,  and  Division 
personnel  was  effective  in  making  some  changes.  A 
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commitment  that  the  soldiers  would  appear  at  12:30  p.m.  on 
the  first  day  instead  of  at  7:30  a.m.  as  originally  planned 
was  obtained.  In  addition,  assurances  were  given  that  the 
troopers  would  be  authorized  to  participate  on  the  second 
day  as  well. 

These  conditions  required  that  the  field  procedures  at 
Fort  Bragg  be  altered.  Instead  of  having  training  on  the 
first  day,  the  aptitude  testing  was  done  during  the 
afternoon  after  the  men  arrived.  They  did  not  arrive  until 
almost  45  minutes  after  the  appointed  time.  ^fter  the  men 
arrived,  the  aptitude  testing  was  conducted  without  compli¬ 
cation  other  than  the  fact  that  it  was  out  of  sequence  from 
the  experimental  plan. 

The  next  day  the  men  arrived  for  training  by  7:30  a.m. 
Some  informed  the  experimenters  that  they  had  to  be 
dismissed  by  approximately  2:30  p.m.  because  it  was  payday 
and  they  had  "payday  activities"  scheduled.  They 
volunteered  to  work  through  lunch  so  they  could  be  dismissed 
early.  Other  troopers  informed  the  Major  that  their 
commanding  officer  had  indicated  that  they  must  return  to 
their  unit  by  1:00  p.m.  for  another  special  inspection. 
Again,  on-site  coordination  by  the  Major  resulted  in 
assurances  that  all  the  men  would  be  present  for  the 
duration  of  the  training  and  testing  that  day.  He  convinced 
the  commanding  officer  that  the  men  should  be  dismissed  from 
the  inspection  so  that  they  could  complete  the  training. 
However,  it  was  decided  to  work  through  the  lunch  hour 
because  the  indications  were  that  some  of  the  men  still 
might  be  pulled  out  for  inspection. 

Fort  Bragg  was  the  only  fort  where  the  possibility  of 
losing  subjects  during  training  or  before  training  ended  was 
a  constant  condition.  It  was  a  condition  that  was  known  to 
both  the  soldiers  and  the  experimenters.  This  meant  that 
the  entire  conduct  of  the  study  at  Fort  Bragg  was  done  in  a 
different  time  frame  and  order  than  at  the  other  sites. 
However,  if  such  arrangements  had  not  been  made,  it  is 
doubtful  if  the  study  could  have  been  conducted  there  at 
all.  The  research  team  was  fortunate  to  have  the  major  as 
an  assistant  because  he  was  able  to  rectify  many  situations 
that  would  have  otherwise  been  beyond  control  at  Fort  Bragg 
or  at  the  other  installations. 

There  were  additional  complications  at  Fort  Bragg.  The 
tracking  head  trainers  were  not  working  properly  during 
training  or  performance  testing.  It  was  learned  that  most 
of  the  THTs  needed  new  seekers  and  therefore  were  not 
picking  up  the  IR  heat  source  very  well.  Some  men  had  to  be 
sent  back  to  their  units  to  get  other  THTs  so  that  there 
would  be  working  equipment  for  the  performance  testing, 
the  first  part  of  the  testing  period,  one  of  the  working 
THTs  started  to  malfunction  intermittently.  This  made  it 
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difficult  to  know  whether  the  gunner  was  making  errors  or 
whether  there  was  really  a  malfunction  in  che  trainer.  It 
was  at  that  point  that  use  of  that  trainer  was  discontinued 
and  someone  was  sent  to  locate  a  different  trainer.  For 
about  one  hour  of  the  performance  testing,  there  was  only 
one  working  THT,  which  slowed  the  progress  of  the  testing 
coniderably . 

3y  the  time  a  new  trainer  was  brought  in,  it  was  almost 
2:00  p.ra.  and  the  men  were  anxious  to  leave  for  the  day, 
having  already  worked  through  lunch.  With  only  about  a  half 
hour  left  to  complete  all  testing,  three  troopers  were 
called  for  the  third  time  to  report  to  the  in. pection  after 
all.  In  all  the  other  instances,  when  their  commanding 
officer  had  recalled  them,  the  Major  had  been  able  to  talk 
the  officer  out  of  it.  In  this  instance,  the  Major  had 
stepped  out  for  a  few  minutes  to  take  care  of  other 
business,  so  the  officer  had  to  be  obeyed.  As  a  result, 
those  troopers  had  to  be  dropped  from  the  study. 

All  in  all,  the  complications  at  Fort  Bragg,  as 
numerous  as  they  were,  did  cast  a  shadow  on  the  fidelity  of 
the  procedures  there.  The  whole  tone  of  the  base  was  quite 
different  from  that  of  any  other  fort  represented  in  the 
study . 

At  Fort  Riley,  the  most  serious  complications  concerned 
the  actual  population  as  well  as  the  conditions  surrounding 
efforts  to  put  them  through  the  training.  Of  the  18 
soldiers  who  appeared  in  the  first  group  at  Ft.  Riley,  only 
16  received  security  clearance  to  enter  the  MTS.  The  other 
two  had  been  court-martialed  and  could  not  be  given 
clearance.  Of  the  23  soldiers  in  the  second  group,  the 
security  clearance  for  5  of  them  was  "unknown."  This  was 
totally  unexpected  because  confidential  clearance  is  a 
prerequisite  to  being  in  the  16P  MOS .  Confidential 
clearance  is  also  required  to  enter  any  MTS.  As  a  result, 
complete  data  for  both  independent  and  dependent  measures 
could  be  collected  on  only  the  16  soldiers  from  the  first 
group  who  had  clearance. 

For  the  second  group  at  Fort  Riley,  independent 
measures  were  collected  on  all  23  soldiers,  without  entering 
the  MTS,  while  clearances  were  being  checked.  The  next  day, 
the  issue  of  security  clearances  for  the  five  soldiers  was 
still  unresolved.  In  addition,  the  primary  piece  of  MTS 
equipment  needed  for  training  had  been  removed  from  the 
premises  for  repair.  Consequently,  no  training  was 
conducted  and  no  performance  data  could  be  collected  for  the 
second  group  at  that  time.  Approximately  30  days  later,  14 
of  the  23  soldiers  from  that  group  were  trained  and  tested 
for  the  first  time.  (This  should  have  been  when  retention 
data  was  collected  on  them. )  Only  one  of  the  five  with 
questionable  security  clearance  status  had  been  able  to  get 
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clearance.  The  other  five  who  did  not  appear  for  training 
were  either  on  leave  or  were  being  held  by  their  commanding 
officers  for  other  duty. 

With  regard  to  the  actual  training,  for  the  first  group 
it  was  conducted  on  the  first  day  and  the  aptitude  testing 
on  the  morning  of  the  second  day.  Other  than  the  fact  that 
training  started  late  on  the  first  day  because  of  the 
clearance  problems,  everything  went  smoothly  and  according 
to  plan.  However,  when  the  operator  of  the  MTS  took  the 
special  film  projector  away  at  the  end  of  the  first  day  to 
be  repaired,  there  was  some  concern  on  the  part  of  the 
investigators.  There  had  been  no  reason  to  suspect  that 
something  had  broken,  because  the  films  for  the  first  group 
all  ran  quite  normally.  Nevertheless,  assurances  were  made 
that  the  projector  would  be  back  in  time  to  train  the  second 
group  two  days  later. 

The  second  group  came  on  the  afternoon  of  the  second 
day  at  Fort  Riley  for  aptitude  testing.  They  were  not 
present  with  the  first  group  at  the  same  time  at  all  during 
training  or  testing  even  though  both  groups  did  receive 
aptitude  testing  on  the  same  day.  This  second  group  at  Fort 
Riley  was  the  only  group  of  soldiers  at  any  fort  to  come  to 
the  experiment  directly  from  having  been  out  on  maneuvers  in 
the  field.  They  were  tired  and  irty  and  had  already  had  a 
full  day’s  work  before  they  reached  the  classroom.  Once  the 
testing  began,  they  seemed  more  fresh  and  relaxed,  probably 
because  it  was  a  change  of  pace  for  them.  All  procedures 
for  aptitude  testing  went  smoothly  and  according  to  plan 
other  than  the  fact  that  the  testing  rook  place  in  an 
afternoon  instead  of  a  morning. 

On  the  next  day,  the  men  arrived  at  the  MTS  along  with 
the  experimenters,  only  to  find  it  locked  with  a  note  from 
the  operator  that  the  projector  would  not  be  fixed  for  "a 
while."  Since  clearance  still  had  to  be  secured  for  some 
men,  as  outlined  earlier,  a  small  wait  seemed  reasonable. 
Unfortunately,  nothing  worked  to  secure  the  clearances  or  to 
repair  the  projector  and  the  men  had  to  be  dismissed  and 
told  to  return  about  30  days  later  for  the  training.  This 
group  is  the  only  group  who  had  such  a  long  time  lag  between 
their  aptitude  testing  and  their  training/performance 
testing.  These  circumstances  were  far  beyond  the  control  of 
the  research  team. 

When  the  research  team  returned  a  month  later  to  train 
the  second  group,  only  14  of  the  23  appeared.  The  training 
began  over  an  hour  late  because  of  a  malfunctioning 
videotape  player  and  another  piece  of  missing  equipment. 

Once  everything  was  there  and  in  working  order,  the  training 
progressed  smoothly.  The  films  worked  well  as  did  the  THTs 
except  for  an  occasional  malfunction  of  the  batteries  for 
the  BCUs.  Such  malfunctions  were  mild  compared  to  what 
happened  at  Fort  Bragg,  so  it  was  not  considered  serious. 
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In  between  the  two  trips  to  Fort  Riley,  the  group  at 
Fort  Hood  was  trained  and  tested.  This  was  the  first  fort 
at  which  there  were  not  all  REDEYE  films  to  be  used  in  the 
MTS.  The  next  generation  up  from  REDEYE  is  the  STINGER 
Missile  System.  It  is  similar  to  the  REDEYE  but  has  a 
qreater  range  and  capability.  Eventually,  all  REDEYE  films 
will  be  replaced  by  STINGER  films.  STINGER  films  have  some 
targets  that  would  be  out  of  range  for  the  Redeye.  For  one 
of  the  oractice  films,  there  was  a  STINGER  film  in  use  at 
Fort  Hoed.  Also,  Film  10  at  Fort  Hood  was  a  STINGER  film. 

It  was  the  judgement  of  all  of  the  experimenters  tnat  the 
STINGER  Film  10  was  not  significantly  different  from  the 
REDEYE  Film  10.  However,  there  was  also  agreement  that  the 
launch  boundary  and  IR  lights  on  the  MTS  console  were 
inaccurate.  As  a  result,  independent  judgements  by  one 
exoerimenter  were  made  with  regard  to  launch  boundary  for 
every  launch. 

In  addition,  all  experimenters  agreed  that  the  IR  spot, 
superimposed  on  the  film,  appeared  to  be  slightly  off  the 
mark.  This  resulted  in  some  errors  that  were  not  the 
gunners'  faults.  There  were  some  complaints  from  the 
gunners  that  the  THTs  were  not  picking  up  IR  properly.  From 
the  collective  observation  of  all  who  were  doing  the 
scoring,  it  was  determined  that  most  of  the  time,  the 
mistakes  that  concerned  acquisition  of  IR  tone  were  the 
fault  of  the  gunners  and  not  of  the  equipment.  One  of  the 
THTs  did  have  a  poorly  functioning  battery  pack.  If  the 
battery  clearly  malfunctioned,  the  gunner  was  given  another 
target  to  engage. 

In  terms  of  sequence  of  activities,  at  Fort  Hood,  the 
training  was  done  on  the  first  day  and  the  aptitude  testing 
on  the  second- day  according  to  the  original  experimental 
plan . 
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APPENDIX  C 


MOVING  TARGET  SIMULATOR  (MTS)  AND 
SCORING  PROCEDURES  DURING 
REDEYE  STUDY 
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Moving  Target  Simulator  (MTS) 
(from  FM  44-23-1,  p.  7-4,  Department  of 
October  1977) 


i 


♦ 


Point  Values  Used  in  Scoring  Film  10  &  Film  12  for  Refresher 
REDEYE  training; 


For  each  try: 

A.  If  the  gunner  did  not  activate  the  weapon  at  all,  did 

not  put  in  the  BCU,  did  not  take  the  cover  off,  did  not 
acquire  the  target  at  all,  or  did  not  continue  to  keep 


the  target  acquired  through  the  sequence:  0  pts . 

3.  If  he  acquired  the  target  only:  1  pt . 

C.  If  he  did  B  above  and  also  uncaged:  2  pts. 

D.  If  B  and  C  above  and  also  superelevated:  3  pts. 


E.  If  B,  C  and  D  above  and  got  a  hit,  but  it  was  either  out 
of  launch  boundary  or  he  violated  65u  angle  rule: 

4  pts . 

F.  If  3,  C  and  D  above  and  got  a  clean  hit:  5  pts. 


(Note:  Condition  D  above  is  not  possible  to  get  without 

also  getting  condition  E  or  F  as  well.  It  was  believed  that 
the  additional  weighting  that  results  for  any  kind  of  hit 
was  appropriate. 

A  try  consists  of  the  time  from  trigger  pull  to  trigger  pull 
or  the  time  that  a  single  target  remains  in  view  (whichever 
comes  first ) . 

It  does  not  count  as  a  try  if  the  gunner  does  not  pull  the 
trigger  UNLESS  he  had  no  other  trigger  pull  during  the  time 
that  the  target  was  in  view. 

There  was  only  one  possible  instance  when  a  gunner  could  get 
a  perfect  score  without  pulling  the  trigger;  that  was  for  a 
target  that  never  came  within  range.  If  he  correctly  did 
NOT  fire  in  that  instance,  he  earned  5  points  for  that  try. 
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APPENDIX  D 


CORRELATION  MATRICES  UPON  WHICH  FACTOR  ANALYSES 
AND  CANONICAL  CORRELATION  ANALYSES  WERE  BASED 


l 
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APPENDIX  D 


CORRELATION  MATRICES  UPON  WHICH  FACTOR  ANALYSES 
AND  CANONICAL  CORRELATION  ANALYSES  WERE  BASED 


In  this  appendix,  two  correlation  matrices  for  each 
sample  are  presented--one  for  the  factor  analyses  and 
another  which  included  both  independent  and  dependent 
variables.  In  addition,  summaries  of  the  variable  .names  and 
•labels  are  repeated  (taken  from  Chapters  III  and  IV)  so  that 
the  reader  does  not  have  to  refer  back  to  the  body  of  the 
report  to  make  interpretations. 
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SUMMARY  OF  INDEPENDENT  AND  DEPENDENT  VARIABLES  COLLECTED 
FROM  REDEYE  GUNNERS  AT  TIME  OF  REFRESHER  TRAINING 


Variable 

Name 

Variable 

Label 

Extended 

Label 

VI 

Age 

V2 

Word 

From  the  Press  Test 

V  3 

Color 

From  the  Press  Test 

V4 

Wintc 

From  the  Press  Test  (Color  naming 
with  distraction) 

(Note: 

V2-V4  purport  to  measure  the  ability 
to  work  under  stress.) 

V5 

Cl  flex 

Closure  Flexibility 

V6 

Cl  spd 

Closure  Speed 

V7 

LTH 

Language  Thurstone 

V8 

QTH 

Quantitative  Thurstone 

V9 

TTH 

Total  Thurstone 

V10 

GEFT 

Group  Embedded  Figures  Test 

Vll 

Pursuit 

From  MacQuarrie  Test 

VI 2 

State 

State  Anxiety 

Vi  3 

Trait 

Trait  Anxiety 

V14 

2dim 

Two  Dimensional  SDatial  Relations 

VI  5 

FA 

Re served /Outgoing 

VI 6 

FB 

Less  Intell/More  Intell 

VI  7 

FC 

Affected  by  feel ings/Emotional ly 
Stable 

V18 

FE 

Humble/ Assertive 

V19 

FF 

Sober/Happy-go- lucky 

V20 

FG 

Expedient/ Conscientious 

V21 

FH 

Shy/Venturesome 

V22 

FI 

Tough-minded /Tender-minded 

V2  3 

FL 

Trusting /Suspicious 

V24 

FM 

Practical /imaginative 

V25 

FN 

Forthright/ Astute 

V26 

FO 

Sel f- Assured /Apprehensive 

V27 

Q1 

Conservative/Experimenting 

V28 

Q2 

G roup- dependent/ Self-sufficient 

V29 

Q3 

Undisciplined  Self-conflict/ 
Controlled 

V30 

Q4 

Relaxed/Tense 

V33 

Film  10 

Film  10  (Fast,  Constant  Speed 

Targets ) 

V34 

Film  12 

Film  12  (Variable  Speed,  Mixed 
Target-Types ) 

V35 

MTS  ANX 

State  Anxiety  for  MTS  Performance 

V3  6 

RRP 

Range  Ring  Profile  Written  Test 

V3  7 

Film  10R 

Film  10  Retention 

V38 

Film  12R 

Film  12  Retention 

V39 

RRPR 

Range  Ring  Profile  Retention 
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CORRELATION  MATRIX  FOR  FACTOR 
ANALYSES  IN  REDEYE  STUDY  (N=61) 
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CORRELATION  MATRIX  FOR  INDEPENDENT  AND  DEPENDENT  VARIABLES  IN  REDEYE  STUDY  (N=61)  (cont) 
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SUMMARY  OF  INDEPENDENT  AND  DEPENDENT  VARIABLES  IN 
CHAPARRAL /VULCAN  ANALYSES 


Variable 

Name 

Variable 

Label 

Extended 

Label 

VI 

Age 

V2 

Word 

From  the  Press  Test 

V  3 

Color 

From  the  Press  Test 

V4 

Wintc 

From  the  Press  Test  (Color  naming 
with  distraction) 

V5 

CLf lex 

Closure  Flexibility 

V6 

Cl  spd 

Closure  Speed 

V7 

LTH 

Language  Thurstone 

V8 

QTH 

Quantitative  Thurstone 

V10 

GEFT 

Group  Embedded  Figures  Test 

Vll 

Pursuit 

From  MacQuarrie  Test 

VI 2 

State 

State  Anxiety 

VI 3 

Trai  t 

Trait  Anxiety 

VI 4 

2dim 

Two  Dimensional  Spatial  Relations 

VI 5 

FA 

Re served /Outgoing 

VI 6 

FB 

Less  Intell/More  Intell 

VI 7 

FC 

Affected  by  f ee lings/Emotional ly 
Stable 

V18 

FE 

Humble/Assertive 

VI 9 

FF 

Sober /Happy-go-lucky 

V20 

FG 

Expedient/Conscientious 

V21 

FH 

Shy/ Venturesome 

V2  2 

FI 

Tough-minded/ Tender-minded 

V2  3 

FL 

Trusting /Suspicious 

V24 

FM 

Practical /imaginative 

V2  5 

FN 

Forthright/ Astute 

V26 

FO 

Self-Assured/ Apprehensive 

V27 

Q1 

Conservative /Experimenting 

V28 

Q2 

Group-dependent/ Self-sufficient 

V29 

Q3 

Undisciplined  Self-conflict/ 
Controlled 

V30 

Q4 

Relaxed/Tense 

V40 

GZPS 

Guilford  Zimmerman  Perceptual  Speed 

ZR6 

ZOVERALL 

Standardized  Overall  Performance 
Rating  (Appendix  F) 

WC5 

EOC  CHAP 

End  of  Course  Final  Proficiency  Test 
(CHAPARRAL) 

WCOMPC 

Summed  Composite  of  4  CHAPARRAL 
Written  Tests  (WC1-WC4)  (See  Table 

28,  p.  83  for  information  about 
WC1-WC4) 

WV6 

Final  Written  VULCAN  Test 

PVC 

PROFCOMP 

Proficiency  VULCAN  Composite  (See 
Table  29 ) 
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DESCRIPTION  OF  THE  PROCEDURES  OF  INTERPRETATION 
FOR  CANONICAL  ANALYSES 


The  procedures  for  interpretation  of  the  results  of 
canonical  correlation  analyses  for  REDEYE,  CHAPARRAL,  and 
VULCAN  data  were  essentially  the  sane.  In  the  effort  to 
make  the  results  of  complicated  statistical  analyses  less 
cumbersome  and  more  understandable  to  the  general  public, 
the  investigators  reasoned  that  if  interpretations  of 
canonical  correlation  results  could  be  explained  in  factor 
terms,  it  would  be  easier  for  readers  to  successfully 
synthesize  the  factor  analytic  and  canonical  results  into  a 
unified  and  meaningful  representation. 

This  appendix  describes  the  manner  in  which  the  two 
different  sets  of  results  were  synthesized  for  inter¬ 
pretation.  The  results  of  each  of  the  three  independent 
factor  analytic  "studies"  (REDEYE,  CHAPARRAL,  and  VULCAN) 
are  so  integral  to  the  respective  canonical  correlation 
results  that  the  latter  cannot  be  effectively  interpreted 
without  the  former. 

The  seven  independent  factors  that  emerged  for  each  of 
the  three  samples  (REDEYE,  CHAPARRAL,  and  VULCAN)  are 
unique  mathematical  composites,  each  of  which  explains 
variance  quite  independently  from  the  other  factors  in  the 
same  series  of  analyses.  Such  is  the  nature  of  carefully 
performed  factor  analyses.  From  this  basis,  and  from  the 
theoretical  discussions  that  explain  and/or  define  each 
factor  (REDEYE,  pages  57-65;  CHAPARRAL,  pages  98-101; 

VULCAN,  pages  112-115),  the  most  useful  way  to  interpret  the 
respective  canonical  correlation  analyses  (for  the  same 
three  sets  of  data)  seemed  to  be  to  integrate  the 
interpretations  with  factor  interpretations  already 
presented . 

The  factor  interpretations  have  been  explained 
thoroughly  and  are  quite  solid,  yet  they  do  not  relate 
specifically  to  performance  on  the  job  or  even  to  per¬ 
formance  in  training.  It  is  the  canonical  correlation 
analyses  results  that  address  the  relation  between  variables 
that  make  up  the  "factors"  (from  the  factor  analyses)  and 
ultimate  performance.  It  is  the  relationships  between  these 
two  sets  of  variables  that  are  of  most  interest  for  the 
present  study. 

Let  the  reader  know  that  even  though  all  variables  that 
made  up  specific  factors  (from  the  factor  analyses)  were  not 
represented  in  each  of  the  final  canonical  analyses,  the 
relation  of  an  entire  factor  (as  represented  by  the 
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components  which  did  survive  into  each  of  the  final 
canonical  solutions)  was  suggested.  Because  of  this, 
variables  which  were  part  of  each  second  iteration  of 
canonical  analylsis  were  interpreted,  at  the  least,  as  a 
component  of  the  appropriate  "named  factor."  They  were 
described  either  as  a  component  of  that  factor  or  perhaps 
using  the  factor  term  itself. 

For  example,  in  the  REDEYE  analysis,  the  "ability  to 
work  under  stress"  was  cited  as  the  "factor"  contributing 
most  to  REDEYE  performance  (Table  47).  In  actuality,  only 
V3,  V4  and  Vll,  (from  the  factor  analysis,  Factor  2:  Ability 
to  Work  Under  Stress,  Table  45)  were  represented  in  the 
canonical  analyses  (Tables  25  and  47).  Of  the  three 
variables  just  named,  only  V3  and  V4  cleanly  loaded  on  only 
the  "ability  to  work  under  stress"  factor,  whereas  Vll  also 
loaded  on  the  "spatial/analytic"  factor  in  the  REDEYE 
sample.  V3  and  V4  are  also  the  only  two  variables 
specifically  designed  as  measures  of  "the  ability  to  work 
under  stress"  that  remained  in  the  second  REDEYE  canonical 
analysis . 

The  "ability  to  work  under  stress”  factor  shown  in 
Table  46  consisted  of  four  other  variables  which  loaded  at 
+.20  and  +.30.  None  of  these  eight  variables  were 
represented  in  the  canonical  analysis  (Table  25),  yet  all 
are  part  of  the  "factor."  Nevertheless,  the  investigators 
have  described  the  canonical  results  in  terms  that  suggest  a 
relationship  with  the  entire  factor.  This  is  appropriate  as 
long  as  one  recognizes  that  the  relationship  suggested 
should  not  be  interpreted  absolutely.  Rather,  it  should  be 
taken  as  it  was  intended;  namely,  as  suggestive.  Firmer 
interpretations  and  conclusions  should  be  explored  in  future 
studies  to  see  if  the  suggested  relationships  of  components 
of  the  factors  may  hold  true  for  the  entire  factors. 

The  "spatial-analytic  factor"  (Factor  1 — Table  46) 
contributed  next  most  to  REDEYE  performane  after  the 
"ability  to  work  under  stress."  The  components  of  the 
REDEYE  "spatial-analytic"  factor  which  were  represented  in 
the  final  REDEYE  canonical  analysis  were  (in  order  of 
magnitude  of  contribution)  V16,  Vll,  V5  and  V10.  A  lesser 
component  of  the  REDEYE  Factor  1  (V25)  also  remained  in  the 
canonical  analysis;  however,  V25  was  more  important  to  the 
"Happy-go-Lucky/Venturesome/Outgoing  factor,"  (Factor  4) 
than  it  was  to  any  of  the  other  factors  of  Table  46.  There 
were  six  other  variables  that  loaded  at  +.30  or  greater  on 
the  "spatial-analytic  factor"  which  were  not  part  of  the 
final  canonical  analysis. 

In  the  effort  to  save  space,  the  investigators  will  not 
document  every  variable  from  the  separate  canonical  analyses 
(REDEYE,  CHAPARRAL,  and  VULCAN)  in  terms  of  the  factors  with 
which  they  are  associated  (Table  45).  Nor  will  they  list 
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the  other  remaining  variables  from  factors  that  were  not 
represented  in  the  separate  canonical  analyses.  Instead, 
the  reader  is  asked  to  generalize  from  the  explanations 
given  thus  far  to  the  remaining  variables  in  the  REDEYE 
analysis  as  well  as  to  all  variables  in  the  CHAPARRAL/VULCAN 
analyses . 

By  careful  inspection  of  Tables  45  and  46  (Factor 
Analyses),  Tables  25,  37,  and  44  (Canonical  Correlation 
Analyses),  and  the  correlation  matrices  found  in  Appendix  D, 
the  reader  should  be  able  to  follow  the  synthesis  of  the 
information  that  eventually  resulted  in  Table  47.  With  this 
in  mind,  no  further  explanations  will  be  given  in  this 
appendix . 
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APPENDIX  F 


RATING 


SCALES  USED  DURING  CHAPARRAL /VULCAN  ANALYSES 
TO  AUGMENT  ARMY  DEPENDENT  MEASURES 
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PREVIOUS  PAGe 
IS  BLANK 


COPY 


INSTRUCTIONS  FCR  TRAINEE  PATINO  PURR 


1.  This  form  will  be'  ussd  to  rate  each  Individual  trainee  on  several 
attributes  you  have  observed  during  training.  The  attributes  on  which 
you  will  be  rating  the  trainees  are  listed  and  defined  below: 

MOTIVATION:  Demonstrates  a  desire  to  learn  all  relevant  information 
and  to  achieve  the  highest  possible  proficiency  In  this  MOS.  Demonstrates 
a  desire  for  career  advancement. 

ABILITY  TO  WORK  AS  A  TEAM  MEMBER:  Develops  good  working  relationship 
with  peers.  Provides  ».\1  possible  assistance  to  other  team  members  when 
working  toward  a  common  goal.  Responds  well  to  authority. 

DECISIVENESS:  Demonstrates  the  ability  to  evaluate  a  situation  and 
quickly  decide  upon  a  proper  course  of  action.  Demonstrates  self- 
confidence  during  decision  making. 

ABILITY  TO  WORK  UNDE?  STRESS'  Demonstrates  the  ability  to  work  quickly 
and  precisely  while  being  subjected  'o  psychological  or  environmental 
stressors. 

VERBAL  ABILITY:  Demonstrates  the  ability  tc  understand  and  communicate 
job-related  information  with  peers  and  superiors  using  the  English 
language. 

OVERALL  PERFORMANCE:  This  rating  13  for  a  measure  of  the  trainee's 
overall  performance  during  training.  To  make  this  xatlng  you  should  not 
entirely  rely  upon  the  trainee's  test  scores  during  training  but 
your  subjective  evaluation  of  the  trainee's  performance,  especially  If 
you  feel  that  h. s/her  performance  is  not  well  reflected  by  the  test 
scores. 

2.  To  complete  the  rating  fme,  draw  a  line  through  each  scale  at  the  point 
you  feel  best  represents  the  trainee's  performance  In  that  area,  A  properly 
completed  form  Is  Included  as  an  example.  This  example  shows  a  trainee 
whose  MOTIVATION  Is  slighllv  above  average  (a  score  of  about  P.2),  ABILITY 
TO  WORK  AS  A  TEA"  MEMBER  is  rather  high  (a  score  or  about  3.9),  DECISIVENESS 
Is  very  low  (0,5).  ABILITY  TO  WORK  UNDE?  STRESS  Is  slightly  below  average 
(1.8).  VER3AL  ABILITY  Is  very  high  (3.9).  and  whose  OVERALL  PERFORMANCE 

Is  somewhat  above  average  'P.o).  Note  that  the  ratings  can  fall  at 
any  point  on  the  0-9  scale. 

Note  also  that  a  space  is  left  on  the  rating  sheet  for  your  comments.  This 
space  can  be  used,  for  example,  to  tell  us  that  you  are  not  confident  of 
you r  ratings  if  you  did  not  know  this  trainee  well,  or  for  any  other 
Information  you  think  might  be  Important  to  us. 
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Trainee  Jiamei 


TRAINEE  RATINC  FORM 


£. 


MCS: 


Rated  by  (nane)  i 


Szqr  StVi.T^ 


DATE: 


MOTIVATION: 


ABILITY  TO  VORK  AS  01 

A  TEAM  MEMBER:  . _ , 


0  1 

DECISIVENESS:  .  I  , 


ABILITY  TO  WORK  0  1 

UNDER  STRESS:  x _ L 

0  1 

VERBAL  ABILITY:  j _ L 

0  1 

OVERALL  PERFORMANCE:  i _ , 


COMMENTS i 


_ OffilSL-TUi-Jurp- 

/&2'tJ..2y .  122— 


Let—  <PJSJ 


Lu 


RATINC  CRITERIA 

0-  As  poor  as  the  poorest  trainees  I  have  known. 

1-  Poorer  than  ?5^  of  the  trainees  I  have  known. 

2-  Average.  Half  of  trainees  are  better,  half  are  poorer 

3-  Better  than  75^  of  the  trainees  I  have  known. 

1-  As  good  as  the  best  trainees  I  have  known. 


COPY 


TRAINEE  RATING  FXjPM 


Trainee  Na^.e: 

MOS: 

Rated  by  Inane): 

DATE: 

MOTIVATION i 

0 

{  _  ,  __ 

1 

- - > _ _ 

2 

- u _ 

3 

-  - 

4 

_ l 

ABILITY  TO  WORK  AS 

0 

1 

? 

3 

u 

A  TEAR  MEMBER: 

1  _ 

1  - 

1 

1 

_  -  ) 

0 

1 

2 

3 

4 

DECISIVENESS: 

1 

1 

1 

.  .  1 

ABILITY  TO  WORK 

0 

1 

2 

3 

4 

UNDER  STRESS: 

1  _ 

1 

I 

_ 1 

0 

1 

2 

3 

4 

VERBAL  ABILITY: 

c 

1—  - 

-1  - 

--  L_  - 

0 

1 

2 

3 

4 

OVERALL  PERFORMANCE: 

J _ 

- 1 - 

_ l _ 

- 1 - 

_ 1 

COW  ENTS  i 


RATING  CRITERIA 

0-  As  poor  as  the  poorest  trainees  I  have  known. 

1-  Poorer  than  75^  of  the  trainees  I  have  known. 

Z-  Average.  Half  of  trainees  are  tetter,  half  are  poorer. 

3-  Better  than  75 %  of  the  trainees  I  have  known. 

4-  As  good  as  the  best  trainees  1  have  known. 
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